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tions  were  compared  to  determine  if  one  was  superior  to  the  other.  Performance 
indices  were  compared  to  determine  if  advantages  existed  for  the  inclusion  of  a  con¬ 
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I.  INTRODUCTION 


There  are  many  ways  to  define  an  optimum  system.  What  is  optimum  in  any 
particular  case  is  dependent  on  the  specific  application  for  which  the  system  is  to  be 
used.  One  useful  and  generally  accepted  definition  of  the  optimum  response  is  that 
a  system  is  optimum  if  it  has  the  least  amount  of  error,  with  error  being  defined 
as  the  difference  between  the  desired  output  and  the  actual  output  of  the  system. 
The  primary  task  of  the  control  systems  engineer  is  to  find  the  most  appropriate 
values  for  the  design  parameters  that  ensures  the  best  performance  for  the  system’s 
application.  He  must  define  the  parameters  so  as  to  produce  a  response  with  the 
closest  features,  characteristics,  and  shape  to  that  which  he  has  defined  as  optimal. 
In  so  doing,  he  has  fulfilled  his  objectives. 

A  point  that  is  worth  stressing  is  the  distinction  between  an  optimum  system 
and  one  that  is  not  optimum,  but  acceptable.  Good  design  characteristics  might  be 
the  outcome  of  a  design  that  meets  certain  specifications  and  general  requirements. 
These  systems  would  be  considered  good  enough,  or  optimum  in  the  sense  that  they 
meet  the  particular  need  for  which  they  were  created.  The  truly  optimum  system  is 
uniquely  distinguished  from  all  others  by  the  fact  that  it  defines  the  best  compromise 
of  design  parameters  to  match  the  ideal  output.  This  study  was  concerned  with  the 
design  of  servomechanisms,  and,  as  such,  the  ideal  output  was  the  mirror  image 
of  the  input.  More  specifically,  the  study  pertained  to  the  class  of  linear-transfer, 
single  input-single  output  systems  called  duplicators. 

The  most  fundamental  relationship  which  gives  the  dependence  of  the  output 
on  the  input  is  usually  the  set  of  differential  equations  describing  the  physical  system. 
The  Laplace  transform  ratio  between  the  system  output  and  its  input  is  the  transfer 
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function  of  the  system.  Transient  response  is  defined  as  the  system’s  behavior  from 
the  time  of  its  initial  disturbance  until  it  reaches  its  steady  state.  It  is  an  unavoidable 
consequence  of  the  nature  of  dynamic  systems.  The  control  engineer  must  design 
for  the  transient  response  which  is  compatible  with  the  desired  specifications.  The 
problem  which  arises  is  the  lack  of  a  practical  mathematical  definition  of  optimal 
transient  attributes  and,  as  a  result,  leads  to  judgment  based  on  intuition. 

In  an  attempt  to  provide  a  more  quantitative  approach  to  the  evaluation  of 
transient  responses,  the  application  of  various  performance  criteria  or  indices  have 
become  widely  used.  The  problem  encountered  in  this  endeavor  is  the  choosing  of 
a  criterion  which  takes  into  account  most  of  the  system  response  characteristics; 
additionally,  the  criterion  must  be  reliable  for  a  range  of  various  systems,  be  easy  to 
apply,  and  be  selective  in  the  sense  that  the  optimum  system  is  readily  discernible. 
The  performance  index  is  generally  an  expression  of  the  key  variables  of  the  system 
or  control  problem  that  is  to  be  optimized.  The  choice  of  the  best  performance 
index  is  one  of  considerable  debate. 

Once  a  performance  index  has  been  chosen  by  the  designer,  the  next  step  is 
to  bridge  the  original  uncompensated  system  to  the  one  defined  by  the  performance 
index.  This  process  is  known  as  system  compensation.  The  selection  of  an  appropri¬ 
ate  and  suitable  compensation  scheme  remains  at  the  discretion  of  the  engineer.  In 
classical  control  theory,  there  are,  generally,  two  basic  methods  of  compensation,  ad¬ 
justment  of  gain  and  the  addition  of  poles  and  zeros.  Since  gain  reduction  hampers 
the  system’s  accuracy,  this  method  is  not  desirable  under  ordinary  circumstances. 
The  addition  of  poles  and  zeros  is  most  frequently  used  and  is  accomplished  through 
the  use  of  filters.  The  addition  or  adjustment  of  these  poles  and/or  zeros  is  done 
either  in  the  forward  path,  cascade  compensation,  or  in  the  minor  feedback  path, 
feedback  compensation. 
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In  this  study,  an  investigation  was  made  into  the  results  of  using  performance 
indices.  The  effect  of  different  cost  functions  was  examined,  with  emphasis  placed  on 
the  weighting  within  these  cost  functions.  After  optimization,  the  roots  of  the  char¬ 
acteristic  equations  were  studied  to  identify  progressive  and  useful  patterns.  Finally, 
nonlinearities  were  introduced  and  their  effect  on  optimal  design  investigated. 
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II.  BACKGROUND  THEORY,  EQUATIONS, 
AND  STANDARD  PROCEDURES 

A.  SYSTEMS  UNDER  INVESTIGATION 

The  design  of  a  feedback  control  system  starts  with  a  plant,  i.e.,  a  process  or 
machine  which  is  to  be  controlled.  A  plant  function  ordinarily  expresses  the  plant 
characteristics. 

It  is  considered  that  the  plants  for  the  systems  of  interest  may  be  expressed 
in  the  form 

j. ’/ 

Gp(S)  =  S(S  +  P,)(S  +  P2)---(S  +  P;v)  ’  (2>1) 

where  Ply  P2>  *  •  •  Pn  are  plant  pole  locations  and  K  is  the  plant  gain.  As  can  be  seen 
from  Equation  2.1,  these  are  all- pole  plants  with  one  pole  located  at  the  origin.  Due 
to  this  one  pole  at  the  origin,  the  plant  is  often  called  a  type-one  system.  Given  a 
specific  reference  input  into  the  plant,  an  output  is  received  which  may  or  may  not 
be  the  desired  output.  To  correct  any  discrepancies,  feedback  is  introduced  around 
the  plant  to  measure  and  correct  its  performance.  Compensation  is  generally  added 
either  in  cascade  with  the  plant,  or  in  a  minor  feedback  path.  The  feedback  not 
only  reduces  the  system’s  error  between  the  reference  input  and  system  output,  but 
also  enhances  the  system’s  stability  to  external  disturbances  and  its  sensitivity  to 
plant  parameter  variations. 

Compensation  for  the  plants  considered  in  this  study  centered  around  the  use 
of  full  state  feedback.  Figure  2.1  shows  the  block  diagram  of  the  proposed  system 
where  k 2,  k\  and  ko  are  the  feedback  gains  of  the  second,  first,  and  zero  derivatives 
of  the  output,  C(S). 


4 


Figure  2.1:  Block  Diagram  of  Plant  with  Feedback  Compensation 

Since  the  modelling  of  different  physical  systems  results  in  different  pole  loca¬ 
tions,  the  choice  of  specific  values  for  the  poles  was  irrelevant  to  the  theory  of  the 
study;  correspondingly,  the  initial  pole  locations  were  arbitrarily  chosen  at  0.0,  -2.0 
and  -6.0.  As  the  study  of  higher-order  plants  became  necessary,  additional  poles 
were  chosen  and  added  to  the  existing  third-order  configuration. 

The  plant  gain,  K,  directly  determined  the  stability  of  the  uncompensated 
system  and  was  of  greater  concern.  A  poor  choice  for  the  value  of  I(  provided  an 
unrealistic  physical  system  and,  depending  on  the  amount  of  positive  or  negative 
phase  margin  produced,  resulted  in  abnormally  high  or  low  feedback  gains.  To 
ensure  unbiased  results,  the  gain  was  chosen  to  place  the  uncompensated  system  at 
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the  limit  of  stability,  or  near  a  zero  phase  margin.  This  point  was  chosen  using  the 
Routh  criterion.  To  provide  an  understanding  of  the  procedure  followed  for  all  the 
Nth-oidei  systems,  the  procedure  for  the  simple  third-order  system  is  provided.  As 
previously  stated,  the  third-order  plant  investigated  was 

G^S(s4(5  +  6)  '  (2'2) 

Using  unity  feedback  as  the  only  form  of  compensation,  the  block  diagram  of  the 
system  is  presented  in  Figure  2.2. 


Figure  2.2:  Third-Order  System  with  Unity  Feedback 

Deriving  the  characteristic  equation  for  the  system  resulted  in  Equation  2.3.  The 
corresponding  Routh  array  is  given  in  Figure  2.3.  From  the  array,  K  had  to  be 

C.E.  =  53  +  8  52  +  125  +  K  (2.3) 

positive  for  the  system  to  be  stable.  If  the  51  entry  was  to  be  positive,  it  was 
necessary  that  K  be  less  than  96.0.  Therefore,  the  bounds  of  K  for  a  stable  system 
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were  0  <  K  <  96.0.  The  value  of  K  chosen  for  this  study  was  48.0.  This  value 
provided  a  small  positive  phase  margin  and  exemplified  a  typical  physical  system. 
The  values  of  K  for  higher-order  systems  were  chosen  in  a  like  manner. 
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Figure  2.3:  Routh  Array  for  Equation  2.3 

B.  COST  CRITERION 

All  compensation  schemes  are  employed  to  design  for  accuracy  at  steady  state. 
Each  parameter  of  the  compensation  can  be  adjusted  to  provide  the  optimal  sys¬ 
tem  performance.  In  addition  to  accuracy  at  steady  state,  the  system  must  have 
acceptable  dynamics.  These  dynamics  are  usually  evaluated  in  terms  of  the  sys¬ 
tem’s  percent  overshoot  of  the  commanded  input,  the  time  required  for  it  to  reach 
a  steady-state  value,  the  time  for  the  error  to  reach  its  first  zero,  the  time  to  reach 
the  maximum  overshoot,  and  the  frequency  of  oscillation  of  the  transient.  These 
criteria,  or  combinations  of  them,  are  used  to  evaluate  the  optimum  performance. 
Using  a  step-input  signal  as  the  reference,  it  is  desired  to  develop  a  single  figure 
of  merit  or  criterion  to  judge  the  “goodness”  of  the  time  response  of  the  system. 
Such  a  criterion  must  have  three  basic  properties:  reliability,  ease  of  application, 
and  selectivity.  It  must  be  reliable  for  a  given  class  of  systems  so  that  it  can  be 
applied  with  confidence,  it  must  be  easy  to  apply,  and  it  must  be  selective  so  that 
the  “best”  system  is  readily  discernible. 
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Note  that  the  systems  studied  here  had  a  zero  steady-state  error  with  a  step 
input.  This  meant  that  the  open-loop  transfer  function  had  to  have  at  least  one 
pole  at  the  origin.  A  perfect  response  required  a  step-function  response  identical  to 
the  input  with  no  error.  Such  a  system  was,  of  course,  impossible,  but  the  amount 
of  total  error  remained  of  prime  concern  and,  logically,  had  to  be  considered  in 
the  performance  index.  The  percent  overshoot  and  the  time  to  the  first  zero  were 
conflicting  characteristics,  i.e.,  their  minimum  values  occurred  at  different  damping 
ratios;  therefore,  these  two  characteristics  required  an  arbitrary  compromise  and 
were  not  used  in  the  cost  function.  The  solution  or  settling  time  appeared  to  combine 
both  properties  and  was  used  in  the  criterion  of  performance. 

Important  papers  were  written  by  Dunstan  Graham  and  R.  C.  Lathrop  [Refs. 
1,2]  discussing  the  general  ideas  of  system  response  and  the  various  criteria  which 
could  be  used  to  evaluate  response.  Some  of  the  error  functions  considered  were 
the  integral  of  squared  error  (ISE),  integral  of  absolute  error  (IAE),  integral  of  time 
multiplied  by  squared  error  (ITSE),  integral  of  squared  time  multiplied  by  squared 
error  (ISTSE),  integral  of  squared  time  multiplied  by  the  absolute  value  of  error 
(ISTAE),  and  integral  of  time  multiplied  by  the  absolute  value  of  error  (ITAE). 
On  the  basis  of  the  demonstrated  superiority  of  the  ITAE  criterion  when  compared 
to  all  others  from  the  standpoints  of  ease  of  applicability  and  clear  selectivity  of 
optima  for  various  classes  of  systems,  Graham  and  Lathrop  [Refs.  1,2]  succeeded  in 
presenting  strong  arguments  for  the  use  of  the  ITAE  criterion  as  the  most  suitable 
measure  of  system  performance.  It  was  this  criterion  which  was  initially  used  during 
the  course  of  this  study. 

The  ITAE  criterion  was  expressed  by  the  integral 

too 

J=  [f  (e(t)H  dt  ,  (2.4) 

Jo 
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where  e(t)  represented  error.  It  was  noted  that  the  t  representing  time  under  the 
integral  sign  had  the  effect  of  penalizing  long  duration  errors.  In  general,  the  e(f) 
was  the  desired  value  of  the  output  minus  the  actual  output.  Since  the  input  of  the 
follower-type  system  was,  generally,  the  desired  output, 

e(t)  =  r(t)  -  c(t)  (2.5) 

where  r(f)  and  c(t)  were  input  and  output,  respectively.  The  system  for  which  the 
value  of  Equation  2.4  was  a  minimum  for  a  step  input  was  then  considered  to  be 
the  optimum  solution. 

Though  useful  in  the  theoretical  sense,  the  ITAE  criterion  often  produced 
an  unrealistic  optimal  solution.  This  problem  arose  from  the  fact  that  the  ITAE 
criterion  assumed  that  infinite  control  input,  r(f),  was  available.  In  reality,  this 
parameter  was  limited  by  the  physical  limitations  of  the  circuitry  or  mechanical 
apparatus.  To  provide  for  this  reality,  a  second  cost  function  was  designed  which 
penalized  the  use  of  the  control  input.  To  maintain  the  customary  nomenclature, 
the  control  input  was  annotated  as  u(t).  The  performance  index  used  was  expressed 
by  the  integral 

J  =  [f  |e(f)|  +gu(f)2]  dt  ,  (2.6) 

where  e(t)  and  t  represented  the  error  and  time,  u(t)  represented  the  control  input, 
and  q  was  a  weighting  factor.  The  control  input,  u(t),  was  squared  to  account  for 
the  fact  that  the  sign  of  the  control  input  was  not  important,  only  the  amount  of 
input  provided  was  of  concern.  The  weighting  factor  q  was  a  number  which  weighted 
the  control  input  relative  to  time  multiplied  by  the  absolute  value  of  the  error.  As 
q  was  increased,  the  cost  of  the  control  input  was  increased;  thereby,  increasing  the 
penalty  for  its  use.  In  a  physical  sense,  the  control  input  may  have  represented  fuel 
consumption  and  q  represented  the  cost  of  that  fuel.  The  system  which  produced 
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the  minimum  value  of  Equation  2.6  for  a  step  input  was  considered  to  be  the  optimal 
solution. 

C.  SIMULATION  PROCEDURE 

Each  of  the  systems  examined  was  modelled  using  the  Dynamic  Simulation 
Language  [Ref.  3:p.  556].  An  example  of  the  computer  code  used  for  the  min¬ 
imization  of  the  fourth-order  system  using  the  ITAE  cost  criterion  is  included  as 
Appendix  A.  The  code  for  the  minimization  of  the  fourth-order  system  using  the 
cost  function  of  Equation  2.6  is  located  in  Appendix  B. 

The  general  procedure  followed  for  the  minimizations  was  to  perform  an  un¬ 
constrained  optimization  of  the  feedback  gains  of  Figure  2.1  based  on  the  multi¬ 
parameter  cost  functions  of  Equations  2.4  and  2.6.  The  minimization  algorithm 
evaluated  the  cost  function  at  a  base  point,  provided  by  an  initial  estimate,  and 
perturbed  each  parameter  by  an  amount  set  by  the  user.  It  evaluated  the  cost  func¬ 
tion  at  each  near  point  and  compared  it  to  the  original  value  of  the  cost  function. 
If  none  of  these  points  produced  a  better  value  of  the  cost  function,  the  step  sizes 
were  decreased  by  a  factor,  set  by  the  user,  and  the  process  repeated.  If  any  of  these 
points  produced  a  better  value  of  the  cost  function,  a  temporary  base  point  was 
calculated  using  the  previous  base  point  and  the  perturbation  which  produced  the 
best  value  of  the  cost  function.  A  search  was  conducted  around  this  new  base  point 
with  the  same  step  sizes  as  the  previous  search.  If  this  search  failed  to  produce  a 
better  value  for  the  cost  function,  the  step  sizes  were  reduced  and  a  new  search  was 
conducted.  The  search  continued  until  either  the  number  of  function  evaluations 
exceeded  the  maximum  iterations  set  by  the  user,  or  the  difference  between  the  cur¬ 
rent  best  value  of  the  cost  function  and  the  previous  best  value  of  the  cost  function 
was  less  than  a  limit  set  by  the  user.  [Ref.  3:p.  557]  The  stopping  limit  for  these 
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studies  was  set  at  0.0001,  with  an  infinite  limit  on  the  number  of  iterations  allowed. 
The  initial  step  sizes  were  chosen  as  ten  percent  of  the  initial  estimate. 

The  derivation  of  the  initial  estimate  was  a  design  problem.  Traditional  fre¬ 
quency  domain  methods  were  used  to  choose  initial  feedback  gains  which  provided 
some  small  degree  of  phase  margin.  Bode  diagrams  were  the  principal  tool  for  this 
procedure. 

The  final  variable  which  entered  into  the  minimization  procedure  was  the  time 
period  over  which  the  system  was  to  be  minimized.  If  the  period  was  chosen  well 
in  excess  of  the  system’s  settling  time,  the  minimization  procedure  gave  erroneous 
results.  This  was  due  to  the  program’s  attempt  to  eliminate  insignificant  fluctuations 
occurring  after  the  settling  time.  The  choice  of  a  minimization  period  less  than 
the  settling  time  placed  undue  emphasis  on  the  time  to  reach  the  first  zero,  and 
caused  unusually  high  values  for  the  lower-order  feedback  gains.  The  settling  times 
encountered  in  this  study  were  between  two  and  ten  seconds;  thus,  the  appropriate 
value  within  this  interval  was  chosen  as  the  minimization  period. 

D.  RELATED  STUDIES 

In  an  article  published  in  1953  by  Dunstan  Graham  and  R.  C.  Lathrop  [Ref. 
1],  the  derivation  of  the  performance  index  of  the  integral  of  time  multiplied  by 
the  absolute  value  of  the  error  was  investigated.  As  stated  earlier,  they  provided  a 
pervasive  argument  in  favor  of  this  criterion  due  to  its  reliability,  selectivity,  and  ease 
of  use.  They  concluded  that  this  criterion  was  reliable  in  that  it  selected  a  damping 
ratio  of  about  0.7,  a  value  which  was  commonly  considered  to  be  optimum.  It  was 
fairly  easy  to  apply,  given  the  time  responses  of  a  system.  Finally,  they  suggested 
that  it  was  selective  in  that  the  difference  between  the  optimum  value  and  other 
values  was  easy  to  distinguish. 
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Their  paper,  as  was  this  study,  was  concerned  with  the  transient  performance 
of  servomechanisms  or  similar  transfer  systems.  Only  those  systems  with  a  steady- 
state  displacement  error  of  zero  when  subjected  to  an  input  step  function  were 
considered. 

The  underlying  importance  of  their  work  was  not  their  conclusion  of  the  best 
performance  index  to  use,  but  their  derivation  and  subsequent  study  of  characteristic- 
equation  standard  forms.  Using  the  step  responses  and  standard  forms  of  the  Butter- 
worth  filters  as  a  mark  against  which  to  measure,  Graham  and  Lathrop  performed 
an  iterative  experimental  determination  of  the  optimum  unit-numerator  transfer 
functions  by  the  application  of  the  minimum  criterion  of  Equation  2.4.  They  found 
that  when  this  minimum  criterion  was  applied  to  the  determination  of  the  optimum 
unit-numerator  transfer  functions  of  various  orders,  the  standard  forms  of  Table  2.1 
were  obtained.  The  corresponding  pole  locations  and  step-function  responses  were 
also  studied  to  determine  if  the  application  of  this  arbitrary  cost  criterion  resulted 
in  a  family  of  systems  with  similar  and  progressive  characteristics.  Unfortunately, 
no  such  trend  was  discovered. 

In  comparing  the  standard  forms  of  Table  2.1  with  the  standard  Butterworth 
forms  presented  in  Table  2.2,  the  standard  forms  of  Table  2.1  had  coefficients  which 
were  slightly  higher  for  the  lower  orders,  and  slightly  lower  for  the  higher  orders. 

In  their  paper,  Graham  and  Lathrop  [Ref.  1]  took  a  large  step  in  a  more 
logical  approach  to  systems  design.  When  one  kept  in  mind  the  limitations  of  the 
analytical  tools  available  at  that  time  period,  namely  the  analog  computer,  their 
work  demanded  even  more  respect.  It  was  the  first  large-scale  attempt  to  formulate 
the  specific  transfer  functions  that  satisfied  a  given  error  criterion. 
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TABLE  2.1:  The  Minimum  ITAE  Standard  Forms  for  Zero-Displace¬ 
ment-Error  Systems 


S  +  U0 

s7  -1-  1.40u)o3  +  w2 
s3  +  1.75w0$2  +  2.15o;2s  +  w3 
s*  +  2.10w„53  +  3.40u>252  +  2.70w3s  -f  u* 
ss  +  2.80o>654  +  5.00u>2$3  +  5.50w3s2  +  3.40o>43  +  w* 

56  +  3.25 o>0s5  +  6.60u>2s4  +  8.60u;333  +  7.45u>4s2  +  3.95u;33  +  o>® 
s7  +  4.475a >0s6  +  10.42u;2s5  +  15.08o>334  +  15.54w453  +  10.64u>|32  +  4.58o>®s  +  w7 
58  +  5.20wo37  +  12.80w256  +  21.60u;3s5  +  25.75u>4s4  +  22.20u;|s3  +  13.30u;®52  +  5.15a;Js  +  a;® 


E.  OBJECTIVES  OF  THE  STUDY 

The  objective  of  this  study  was  not  to  prove  the  superiority  of  one  error  cri¬ 
terion  over  another.  No  one  criterion  served  all  needs.  The  proper  criterion  was 
implied  by  the  application  and  may  have  required  that  emphasis  be  placed  on  speed 
rather  than  damping,  or  on  accuracy  rather  than  the  time  to  the  first  zero  error.  The 
study  centered  around  the  integral  of  time  multiplied  by  the  absolute  value  of  the 
error.  This  criterion  appeared  to  be  a  criterion  that  was  preferred,  and  one  which 
adequately  defined  or  evaluated  the  transient  performance  of  a  zero-error  transfer 
function  to  a  step  input.  The  adequacy  of  this  criterion  was  based  upon  the  fact 
that  it  gave  recognition  to  the  concept  that  the  sign  of  the  error  was  not  important; 
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TABLE  2.2:  The  Butterworth  Standard  Forms 


S  +  v0 

a2  +  1.40wo3  +w2 
a3  +  2.00woa2  +  2.00w2a  +  u;3 
s*  +  2.60woa3  +  3.40u;2a2  +  2.60w3a  +  w* 
a5  +  3.24u>0a4  +  5.24w2a3  +  5.24w3a2  +  3.24 u*s  + 
a6  +  3.86w0a5  +  7.46u>2s<  +  9.13w3a3  +  7.46u£s2  +  3.86w*a  +  w8 
a7  +  4.50u>oa6  +  10.10w2a5  +  14.60w3a“  +  14.60u£s3  +  lO.lOu;8*2  +  4.50u>®a  +  w7 
a8  +  5.12u>0a7  +  13.14u;2a6  +  21.84w3a5  +  25.69wjs<  +  21.84w8a3  +  13.14ur8a2  +  5.12u>7a  +  w8 


furthermore,  it  recognized  that  the  existence  of  an  initial  error  had  to  be  accepted, 
but  that  the  system  had  to  be  penalized  if  any  error  existed  after  this  initial  period. 

Initially  accepting  this  criterion,  the  study  delved  into  the  manner  and  effect 
of  its  use  with  both  linear  and  nonlinear  systems.  The  second  objective  was  to 
determine  if  the  standard  forms  presented  by  Graham  and  Lathrop  in  Table  2.1 
were  accurate  enough  to  be  used  in  modern  design.  Thirdly,  this  study  examined 
the  root  patterns  resulting  from  minimization  using  this  criterion  to  determine  if 
a  standard,  predictable,  and  useful  trend  emerged.  The  study  concluded  with  the 
effects  of  adding  a  control  cost  to  the  performance  index. 
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III.  OPTIMIZATION  USING  THE  INTEGRAL 
OF  TIME  MULTIPLIED  BY  THE  ABSOLUTE 

VALUE  OF  ERROR 


A.  PROBLEM  OF  INCREASING  BANDWIDTH 

When  used  in  conjunction  with  full-state-feedback  compensation,  the  cost  cri¬ 
terion  of  the  integral  of  time  multiplied  by  the  absolute  value  of  the  error  did  not 
reach  a  minimum  value  unless  a  specific  value  was  chosen  for  the  system’s  band¬ 
width.  Consider  the  system  of  Figure  3.1  which  utilized  the  plant  of  Equation  2.2. 
As  stated  in  Chapter  I,  the  pole  locations  were  arbitrarily  chosen  and  the  plant  gain 
of  48.0  was  chosen  to  place  the  uncompensated  plant  near  the  stability  limit.  In 
order  to  maintain  the  error  definition  given  in  Equation  2.5  and  correctly  measure  the 
cost  function,  a  block  diagram  manipulation  wTas  performed.  The  resulting  system 
maintained  a  unity-feedback  loop,  and  is  presented  in  Figure  3.2.  As  shown  in  Figure 
3.2,  when  unity  feedback  was  added,  the  gain  of  the  zero-order  derivative  became 
a  forward-path  gain.  Reducing  this  system  to  an  equivalent  open-loop  transfer 
function,  Equation  3.1  was  obtained. 

r  _ (48)(*„) _ 

'  S[S!  +  (8  +  48itI)5  +  (12  +  48i-,)] 

The  minimization  of  this  transfer  function  adjusted  the  k 2,  k\  and  ko  terms 
until  the  cost  function  of  Equation  2.4  was  at  its  smallest  value.  By  inspection  of 
this  cost  function,  it  was  seen  that  a  reduction  in  settling  time  or  a  reduction  in 
total  error  drove  the  function  to  lower  values.  Control  theory  suggested  that  these 
two  criteria  were  in  conflict,  i.e.,  a  reduction  in  settling  time  caused  an  increase  in 
total  error.  As  the  system  increased  its  speed  to  finish  its  transient  in  a  smaller 


(3.1) 


15 


Figure  3.1:  Block  Diagram  of  Compensated  Third-Order  System 

time  period,  its  percent  overshoot  of  the  steady-state  value  increased;  this  caused  a 
corresponding  increase  in  error.  Following  this  theory,  one  might  assume  that  there 
was  a  minimization  point  where  the  conflict  between  settling  time  and  total  error 
was  resolved;  consequently,  the  system  would  converge  to  an  optimum  value.  In 
practice,  this  optimum  value  was  never  reached.  Using  full-state  feedback  with  all 
gains  variable,  minimization  using  the  integral  of  time  multiplied  by  the  absolute 
value  of  the  error  could  not  be  accomplished.  The  explanation  of  this  phenomena 
was  that  although  settling  time  and  error  were  in  conflict,  a  substantial  increase  in 
gain  caused  a  decrease  in  settling  time;  consequently,  the  value  of  the  cost  index 
could  always  be  reduced  by  increasing  the  gain  of  the  system.  The  increase  in  the 
magnitude  of  the  error  caused  by  the  increase  in  gain  was  not  enough  to  offset 
the  reduction  in  the  settling  time.  At  any  operating  point,  the  value  of  the  cost 
function  could  be  reduced  by  simply  increasing  the  gain  of  the  zero-order  derivative. 
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Figure  3.2:  Block  Diagram  of  Compensated  System  with  Unity  Feedback 

Effectively,  the  resonant  frequency  of  the  system  was  being  increased.  In  polynomial 
form,  the  plant  transfer  function  is  given  by  Equation  3.2. 

48 


GP(S)  = 


(3.2) 


S(S2  +  8S  -f  12) 

This  implied  a  resonant  frequency  of  -^48  or  6.93.  After  full-state-feedback  com¬ 
pensation,  the  closed-loop  transfer  function  is  given  by  Equation  3.3. 

C(S)  _  m0 

R{S )  ~  S3  +  (8  +  48it2)S2  +  (12  +  48 jfc,)5  +  m0  (3'3) 

In  this  form,  it  was  seen  that  the  resonant  frequency  was  now  a  function  of  the 
zero-order  derivative,  ko.  In  this  case,  the  resonant  frequency  was  ^/48£o-  Clearly, 
as  k0  increased,  the  resonant  frequency  increased.  The  result  was  a  substantial  and 
unrealistic  increase  in  the  bandwidth  of  the  system. 

These  relationships  were  discovered  by  examining  the  results  of  a  partial  opti¬ 
mization  of  various  third-order  systems.  The  results  are  presented  in  Tables  3.1  and 
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3.2.  Using  Equation  2.2  with  a  gain  of  48.0,  the  pole  at  S  =  -6.0  wa s  varied  between 
-0.01  and  -1000.0  in  order  to  ascertain  the  pole’s  effect  on  the  value  of  the  cost  index. 
From  Table  3.1,  it  could  be  seen  that  a  partial  minimization  always  resulted  in  an 
unusually  high  value  for  the  ko  term  and  no  definite  pole  pattern;  furthermore,  the 
cost  function  remained  short  of  minimization.  Realizing  that  ko  was,  in  effect,  a  for¬ 
ward  gain,  the  plant  of  Equation  2.2  was  studied  using  various  values  for  the  plant 
gain.  The  results  of  this  constant- pole,  variable-gain  minimization  are  presented  in 
Table  3.2.  Rather  than  attempt  a  complete  minimization,  which  had  henceforth 
proved  unfruitful,  a  partial  minimization  was  conducted  to  bring  the  cost  index  to 
an  arbitrary  value  of  approximately  0.002.  From  Table  3.2,  it  can  be  seen  that  as 
the  plant  gain  was  raised  to  higher  values,  the  ko  term  compensated  by  lowering 
its  value;  correspondingly,  as  the  plant  gain  was  lowered,  the  k0  term  compensated 
by  raising  its  value.  No  definite  pole  pattern  was  discovered.  The  trend  in  the  k0 
term  indicated  that  the  minimization  was  responding  to  changes  in  the  plant  gain 
which  was,  in  effect,  a  changing  of  the  bandwidth.  To  maintain  the  cost  function 
at  a  predetermined  figure,  the  ko  maintained  an  inverse  relationship  to  the  value  of 
the  plant  gain. 
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TABLE  3.1:  Partial  Minimization  of  Third-Order  System  with 
Constant  Gain  and  Varying  Pole  Locations 


PLANT 

COST 

FEEDBACK 

GAINS 

ROOTS 

48 

S(S+2)(S+.01) 

0.00250 

k2  =  8.69 

ki  =  2,010.00 

k0  =  191,000.00 

-125.2  +  j  196.8 
-125.2  -  j  196.8 

-168.0 

48 

S(S+2)(S+1) 

0.00257 

k2  =  2.37 

ki  =  161.00 

k0  =  6,020.00 

-25.4  +  j61.1 

-25.4  -  j61.1 

-66.0 

48 

S(S+2)(S+5) 

0.00255 

k2  =  2.52 

ki  =  181.00 

k0  =  6,760.00 

-29.0  +  j61.6 

-29.0  -  j61.6 

-69.9 

48 

S(5+2)(S+6) 

0.00259 

k2  =  2.04 

ki  =  145.00 

k0  =  5,410.00 

-22.4  +  j61.3 

-22.4  -  j61.3 

-60.9 

48 

S(S+2)(S+10) 

0.00254 

k2  =  2.31 

k{  =  171.00 

k0  =  6,420.00 

-27.1  +  j61.2 

-27.1  -  j*61.2 

-68.71 

48 

S(S+2)(S+100) 

0.00254 

k2  =  1.79 

ki  =  314.00 

k0  =  12,500.00 

-47.3  +  j64.9 

-47.3  -  j64.9 

-93.2 

48 

S(S+2)(S+1000) 

0.00254 

k2  =  8.93 

ki  =  308.00 

k0  =  149,000.00 

-54.7  +  j’49.1 

-54.7  -  j49.1 

-1,321.0 

19 


TABLE  3.2:  Partial  Minimization  of  -|-+2^<+6)  With  Varying  Gains 


PLANT 

GAIN 

COST 

FEEDBACK 

GAINS 

ROOTS 

k2  = 

91.70 

-29.1 

+  J64.2 

1.2 

0.00277 

k\  = 

7,040.00 

-29.2 

-  j'64.2 

h  = 

247,000.00 

-59.0 

k2  = 

10.00 

-30.2 

+  j62.4 

12.0 

0.00259 

k\  = 

743.00 

-30.2 

-  J62A 

k0  = 

27,400.00 

-68.0 

to 

II 

2.04 

-22.38 

+  j61.3 

48.0 

0.00259 

k\  = 

145.00 

-22.38 

-  j61.3 

II 

O 

5,410.00 

-60.9 

k2  = 

1.73 

-52.9 

+  J85.6 

96.0 

0.00256 

ki  = 

181.00 

-52.9 

-  J85.6 

II 

O 

7,230.00 

-68.6 

k2  = 

1.85 

-90.8 

+  j55.9 

600.0 

0.00251 

k\  = 

155.00 

-90.8 

-  J55.9 

ko  = 

6,930.00 

-306.0 

k2  = 

0.70 

-76.7 

+  j52.6 

1,200.0 

0.00250 

h  = 

95.70 

-76.7 

-  j52.6 

h  = 

4,990.00 

-691.9 

II 

0.58 

-69.9 

+  j50.7 

12,000.0 

0.00251 

ki  = 

79.70 

-69.9 

-  j50.7 

ko  = 

4,220.00 

-6790.5 

k2  = 

0.53 

-69.1 

+  j  50.2 

120,000.0 

0.00251 

h  = 

73.70 

-69.1 

-  j50.2 

ko  = 

3,840.00 

-63,900.0 
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To  prove  the  failure  of  the  cost  index  to  minimize  the  system  in  the  absence 
of  a  set  bandwidth,  several  complete  minimizations  were  attempted.  None  of  these 
were  successful.  As  an  example,  the  transfer  function  of  Equation  3.4 

48.0 


G,(S)  = 


(3.4) 


S(S  +  2.00)(S  +  0.01) 
was  attempted.  Minimization  found  feedback  gains  of  =  33.19,  ki  =  33,560.00 
and  kQ  =  110,260,000.00  with  a  cost-index  value  of  6.25  x  10-6.  The  system  re¬ 
mained  unminimized.  Theoretically,  the  system  could  only  be  minimized  for  ko 
equal  to  infinity.  The  resonant  frequency  of  the  uncompensated  plant  was  6.93  radi¬ 
ans/second.  Using  full-state  feedback  with  partial  minimization,  the  characteristic 
equation  became 


S3  -I-  (1.6  x  103)s2  +  (1.61  x  106)S  -I-  5.29  x  109  =  0  . 


(3.5) 


This  equation  implied  a  resonant  frequency  of  1,742.69  radians/second.  The  increase 
was,  obviously,  unrealistic. 

B.  FIXING  THE  BANDWIDTH 

In  the  previous  section,  the  problem  of  an  ever-increasing  natural  frequency 
was  presented.  This  problem  was  encountered  because  of  the  nature  of  the  com¬ 
pensation  used.  The  zero-order  derivative  had  the  effect  of  a  forward  gain  in  the 
system,  thereby  limiting  the  ability  to  optimize  the  system  using  the  integral  of 
time  multiplied  by  the  absolute  value  of  the  error.  In  this  section,  the  compensation 
scheme  was  adjusted  to  alleviate  this  problem.  In  the  next  section,  the  effects  of  a 
nonlinear  system  was  investigated. 

The  general  form  of  the  characteristic  equation  for  a  third-order  system  is 
given  in  Equation  3.6,  where  u>0  is  a  selected  frequency  commonly  used  to 


i 3  -f-  Au) o  S 2  -f-  Bu?q  S  -J-  —  0 


(3.6) 
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approximate  the  natural  frequency;  A  and  B  axe  constants.  Throughout  the  remain¬ 
der  of  the  study,  u>0  was  referred  to  as  the  natural  or  resonant  frequency.  Though  this 
equality  actually  only  held  true  for  second-order  systems,  u> 0  was  proportional  to  the 
natural  frequency  for  higher-order  systems.  The  equation  of  the  closed- loop  transfer 
function  of  a  system  using  full-state  feedback  compensation  is  given  in  Equation  3.7, 

r  IS)  = _ (G)(M _ 

pl  '  S3  +  (.4  +  Gk7)S2  +  (B  +  Gkj)S  +  Gkq 

where  G  is  the  gain  of  the  uncompensated  plant  and  all  other  variables  are  as 
previously  defined.  Equating  terms  of  Equations  3.6  and  3.7,  the  value  of  u>0  was 

wo  =  \fGko  •  (3.8) 

Since  the  gain,  G,  was  presumed  to  be  a  fixed  parameter,  the  ko  term  could  be 
adjusted  to  provide  the  desired  natural  or  resonant  frequency.  Notice  that  this  now 
fixed  ko  to  a  constant  value  and  left  the  designer  with  N  —  1  gains  with  which  to 
adjust  the  optimal  response. 

For  the  third-order  system  under  study,  the  gain  was  48.0.  The  resonant 
frequency  was  approximated  by  u>0  and  set  at  10.0  radians/second;  therefore,  the 
ko  term  was  set  at  20.83.  The  block  diagram  of  the  compensated  system  with  the 
resonant  frequency  fixed  at  a  value  of  10.0  radians/second  is  given  in  Figure  3.3. 

This  system  was  optimized  using  the  integral  of  time  multiplied  by  the  absolute 
value  of  the  error.  Unlike  the  results  obtained  in  the  absence  of  a  fixed  resonant 
frequency,  the  cost  index  of  this  system  possessed  an  absolute  minimum  of  3.1386  x 
10-2.  It  was  important  to  note  that  the  value  of  the  cost  function,  by  itself,  had  no 
real  meaning.  It  served  as  only  a  benchmark  against  which  other  similar  systems 
could  be  compared.  Its  numerical  value  was  dependent  on  the  integration  method 
used,  the  duration  of  the  minimization  effort,  and  other  procedural  techniques.  It 


(3.7) 
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Figure  3.3:  Block  Diagram  of  Compensated  System  with  Resonant  Fre¬ 
quency  Set  At  =  10.0 

was,  therefore,  critical  to  maintain  a  constant  methodology  in  the  minimization 
effort. 

Desiring  to  compare  the  results  obtained  with  a  set  resonant  frequency  with 
those  obtained  when  the  resonant  frequency  was  variable,  the  study  described  in 
Chapter  III,  Section  A  was  repeated.  The  pole  located  at  S  =  —6.0  was  varied 
in  order  to  determine  its  effect  on  the  optimal  solution.  In  this  case,  the  pole  was 
varied  between  -1.0  and  -1000.0.  The  results  are  presented  in  Table  3.3. 
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TABLE  3.3:  Minimization  of  Third-Order  System  with  Constant  Gain, 
Constant  Resonant  Frequency,  and  Varying  Pole  Locations 

'  GRAHAM  AND 

UNCOMPENSATED  COST  FEEDBACK  LATHROP  ROOT 

PLANT  GAINS  PREDICTED  GAINS  LOCATIONS 


48 

5(5+3j(STT) 

3.1380  xlO"3 

i,  =  4.48 
k,  =  0.31 

i,  =  4.44 
k,  =  0.30 

-5.37  ±;10.G0 
-7.07 

48 

5(5+2)(5+e) 

3.1380  xlO'3 

Jb,  =  4.28 
k,  =  0.21 

k ,  =  4.23 
k,  =  0.20 

-5.40  ±j  10.50 
-7.07 

48 

S(5  +  2)(S+10) 

3.1382  xlO"3 

*,  =  4.11 
*,  =  0.12 

i,  =  4  06 
k,  =  0.12 

-5.37  ±;  10.50 
-7.08 

48 

S(5+2)(5+100) 

3.1265  xlO'3 

i,  =  0.34 
k ,  =  -1.76 

i,  =  0.31 
k,  =  -1.76 

-5.31  ±>10.65 
-7  04 

5(S+2)(S+IOOOJ 

2.9625  xlO'1 

i,  =  -37.26 
k,  =  -20.51 

i,  =  -37.19 
k ,  =  -20.51 

-5  12  ±>10.53 
-7.28 

By  examination  of  the  table,  it  was  seen  that  the  value  of  the  cost  index 
remained,  essentially,  constant;  moreover,  the  roots  of  the  characteristic  equation 
remained  fixed.  It  was  noted  that  the  feedback  gains  steadily  decreased  in  magnitude 
as  the  plant  pole  location  was  increased  from  -1.0  to  -1000.0.  These  results  were 
in  congruence  with  control  theory.  The  roots  of  the  denominator  polynomial  of  the 
closed-loop  transfer  function  determined  the  transient  characteristics  of  the  system. 
Using  the  integral  of  time  multiplied  by  the  absolute  value  of  the  error,  there  was 
only  one  root  pattern  which  provided  the  optimal  response.  Since  the  use  of  full-state 
feedback  assumed  that  the  roots  of  the  system  could  be  placed  at  any  location,  the 
feedback  gains  adjusted  themselves  to  attain  the  optimum  root  pattern  of  —5.0  ± 
j‘10.0  and  —7.0.  As  the  pole  location  moved  farther  into  the  left-half  plane,  its 
effect  on  the  system’s  response  became  negligible;  accordingly,  the  need  for  high 
feedback  gains  was  reduced.  The  gains  steadily  decreased  and,  at  the  pole  location 
of  S  =  —100.0,  actually  became  positive  feedback. 
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To  illustrate  the  standard  optimal  response,  the  step  response  of  the  system 
was  conducted  for  pole  locations  at  the  extremes  of  S'  =  —1.0  and  S  =  —100.0. 
These  responses,  as  shown  in  Figures  3.4  and  3.5,  were  almost  identical.  From 
another  point  of  view,  the  error,  cost,  and  control  versus  time  are  plotted  in  Figures 
3.6  and  3.7.  As  viewed  from  this  perspective,  the  transient  dynamics  again  showed 
identical  characteristics.  Figure  3.8  is  a  plot  of  the  root  locations  for  the  systems 
optimized  in  Table  3.3.  This  root  pattern  remained  constant  for  all  third-order 
systems  optimized  with  this  cost  index.  The  radial  distance  of  these  roots  from  the 
origin  was  a  function  of  the  chosen  natural  frequency.  As  the  natural  frequency 
was  increased,  the  pattern  moved  further  into  the  left-half  plane;  likewise,  if  the 
frequency  was  decreased,  the  roots  moved  toward  the  right-half  plane.  The  roots, 
of  course,  never  crossed  into  the  right-half  plane. 
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Figure  3.4:  Step  Response  of  Minimized  Third-Order  System  with  Pole 

at  S=-1.0 
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Figure  3.5:  Step  Response  of  Minimized  Third-Order  System  with  Pole 

at  S=-100.0 
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Figure  3.6:  Plot  of  Error,  Cost,  and  Control  Versus  Time  for 
Third-Order  System  with  Pole  at  S=-1.0 
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Figure  3.7:  Plot  of  Error,  Cost,  and  Control  Versus  Time  for 
Third-Order  System  with  Pole  at  S=-100.0 
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Figure  3.8:  Plot  of  Root  Locations  for  Third-Order  System  with 

Varying  Pole  Locations 
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It  was  of  interest  to  compare  these  results  with  those  produced  by  the  Graham 
and  Lathrop  standard  forms  as  presented  in  Table  2.1.  For  the  third-order  system, 
the  standard  form  was  given  as 

S3  +  \.lbu0S2  +  2.15u^S'  +  .  (3.9) 

From  Equation  3.6,  the  characteristic  equation  of  the  compensated  system  was 

S3  +  (A  +  Gk2)S2 +  (B  +  Gkl)S  +  Gk0  .  (3.10) 

Given  an  u0  equal  to  10.0  radians/seconds,  it  was  possible  to  simply  solve  for  the 
feedback  gains.  As  an  example,  the  uncompensated  plant  of  Equation  3.2  was 
considered.  The  value  of  A  was  8.0,  the  value  of  B  was  12.0,  and  the  value  of  G  was 
48.0.  Equating  the  coefficients  of  Equations  3.8  and  3.9  resulted  in 

8  +  48(62)  =  1.75(10)  (3.11) 

and 

12  +  48(6,)  =  (2.15)(10)2  .  (3.12) 

Solving  for  the  feedback  gains,  Graham  and  Lathrop  predicted  k2  =  0.198  and 
6,  =  4.230.  This  procedure  was  repeated  for  the  various  pole  locations  studied,  and 
the  results  are  presented  in  the  data  of  Table  3.3.  Graham  and  Lathrop’s  calculations 
proved,  at  least  for  the  third-order  system,  to  be  correct  within  one-hundredth  of 
the  actual  value.  This  topic  is  examined  in  more  detail  later  in  the  study. 

All  of  the  results  found  with  the  third-order  system  were  generalized  to  higher- 
order  systems,  i.e.,  all  systems  have  a  definite  pole  pattern  which  minimizes  the  cost 
index.  If  the  system  parameters  change,  resulting  in  a  change  of  pole  locations 
within  the  plant,  the  state  feedback  gains  adjust  themselves  to  return  the  roots  to 
their  optimal  locations.  An  increase  in  u>0  causes  a  shift  of  the  pole  pattern  to  the 
left,  and  a  decrease  in  u;q  causes  the  pattern  to  shift  to  the  right. 
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C.  THE  EFFECTS  OF  NONLINEARITIES 


Up  to  this  point,  only  linear  systems  or  those  that  could  be  approximated  as 
linear  systems  were  considered.  Because  of  the  relative  simplicity  and  straightfor¬ 
wardness  of  such  systems,  much  insight  was  gained  as  to  the  dynamics  of  linear 
systems  designed  by  the  use  of  the  cost  index;  however,  linear  systems  never  truly 
exist  in  practice.  All  physical  systems  are  nonlinear  to  some  extent.  Linear  feed¬ 
back  control  systems  are  idealized  models  that  axe  fabricated  by  the  analyst  purely 
for  the  ease  of  design.  When  the  magnitude  of  the  signals  in  a  control  system  is 
limited  to  a  range  in  which  system  components  exhibit  linear  characteristics,  the 
system  is  essentially  linear.  These  linear  characteristics  are  usually  tested  through 
the  principle  of  superposition.  If  superposition  applies,  the  system  is  linear.  When 
the  magnitude  of  the  signals  are  extended  beyond  the  range  of  linear  operation,  the 
system  can  no  longer  be  considered  linear.  Quite  often,  nonlinear  characteristics  are 
intentionally  introduced  in  a  control  system  to  improve  its  performance  or  provide 
more  effective  control.  An  on-off  (bang- bang)  type  of  controller  is  often  used  to 
achieve  minimum-time  control.  This  type  of  control  is  found  in  many  missile  or 
spacecraft  control  systems.  In  the  altitude  control  of  missiles,  jets  are  mounted  on 
the  sides  of  the  vehicle  to  provide  reaction  torque.  These  jets  are  controlled  in  a 
full-on  or  full-off  fashion. 

Nonlinearities  can  be  continuous  or  discontinuous.  Continuous  nonlinearities 
are,  as  their  name  implies,  present  for  the  duration  of  the  system’s  function.  The 
relationship  between  an  applied  force  and  the  resulting  deformation  of  a  spring 
is  considered  to  be  a  continuous  nonlinearity.  The  second  type  of  nonlinearity  is 
the  discontinuous  nonlinearity.  Up  to  a  certain  size  input,  the  output  is  directly 
proportional;  but,  for  greater  or  smaller  inputs,  the  output  remains  constant.  It 
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was  with  discontinuous  nonlinearities  that  this  study  was  concerned.  Henceforth, 
the  term  nonlinearity  refers  to  those  of  a  discontinuous  nature. 

Several  forms  of  nonlinearities  are  very  often  encountered.  These  nonlinearities 
are  frequently  referred  to  as  fast  nonlinearities,  which  implies  that  their  range  of 
operation  changes  at  a  fast  rate  compared  to  the  response  time  of  the  system.  [Ref. 
4:p.  601]  The  most  common  of  these  fast  nonlinearities  are  dead  zone,  backlash  or 
hysteresis,  and  saturation  or  limiting.  A  dead  zone  is  a  range  of  input  for  which  there 
is  no  output.  Backlash  is  most  commonly  associated  with  the  dead  play  between 
coupled  gear  members.  This  study,  however,  dealt  solely  with  the  nonlinearity  of 
saturation.  Many  components  are  linear  up  to  a  given  input  signal.  For  larger 
signals,  the  output  may  not  be  proportional  to  the  input  or  may  even  be  limited 
to  some  constant  value.  Although  the  transition  between  this  linear  and  nonlinear 
region  may  be  gradual,  the  transfer  characteristic  is  often  represented  by  straight 
line  segments.  The  system  is  then  said  to  be  piecewise  linear.  [Ref.  4:pp.  600-603] 
Figure  3.9  shows  the  ideal  saturation  curve  that  was  used  in  this  study. 


Figure  3.9:  Ideal  Saturation  Curve 
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For  linear  systems,  there  are  a  large  number  of  analytical  and  graphical  tech¬ 
niques  for  design  and  analysis;  however,  nonlinear  systems  are  very  difficult  to  treat 
mathematically,  and  there  are  no  general  methods  that  may  be  used  to  solve  a  wide 
class  of  nonlinear  systems.  The  treatment  of  nonlinearities  in  this  study  attempted 
only  to  be  illustrative  and,  most  certainly,  not  exhaustive.  It  dealt  only  with  the 
effects  of  saturation  on  all-pole  systems  which  were  optimized  using  either  Equation 
2.4  or  Equation  2.6. 

The  effect  of  the  nonlinearity  depends  on  its  position  within  the  system.  Sat¬ 
uration  effects  are,  normally,  present  in  one  of  two  areas,  at  the  input  into  the  plant 
or  at  the  input  into  the  system.  The  most  common  of  these  is  at  the  input  into  the 
plant  where  it  limits  the  amount  of  control  input  used.  Referring  to  Figure  3.10, 
saturation  points  1  and  2  respectively  depict  the  relative  position  of  system  and 
plant  saturation. 


Figure  3.10:  Block  Diagram  Showing  Points  of  Possible  Saturation 


34 


Saturation  point  2  effectively  limits  the  control  to  the  plant.  This  point  could 
represent  an  amplifier  with  specific  saturation  limits,  or  a  motor  whose  magnetic 
field  has  saturation  properties.  To  study  the  effects  of  this  type  of  saturation,  the 
piecewise-linear  saturation  curve  of  Figure  3.9  was  used  with  upper  and  lower  satu¬ 
ration  limits  of  30.0  and  -30.0.  The  plant  of  Equation  3.2  was  used  and  compensated 
with  full-state  feedback.  A  block  diagram  of  the  system  is  shown  in  Figure  3.11. 


Figure  3.11:  System  with  Nonlinearity  Present 

As  before,  the  resonant  frequency  was  set  to  10.0  radians/second  by  fixing  the  value 
of  the  zero-derivative  feedback  gain  at  20.83. 

The  objective  of  this  investigation  was  to  evaluate  the  performance  of  the 
given  cost  index  in  the  presence  of  nonlinearities.  The  approach  used  was  to  first 
set  the  feedback  gains  at  the  value  obtained  through  the  optimization  of  the  linear 
system.  The  system  was  then  simulated  for  various  amplitudes  of  step  input,  and 
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the  value  of  the  cost  index  recorded.  The  saturation  nonlinearity  was  then  inserted 
into  the  system  at  saturation  point  2  in  Figure  3.10.  Using  the  same  “linear” 
feedback  gains  and  step  inputs,  the  system  was,  again,  simulated  and  the  value  of 
the  cost  index  recorded.  Finally,  the  minimization  process  was  repeated  with  the 
nonlinearity  present.  New  optimal  feedback  gains  were  determined  and  used  in  a 
third  simulation  of  the  system.  The  resulting  values  for  this  three-part  procedure 
are  presented  in  Table  3.4. 
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STEP  NONLINEAR  COST  OF  LINEAR  COST  OF  NONLINEAR  COST  OF  NONLINEAR 
SIZE  OPTIMAL  SYSTEM  WITH  LINEAR  SYSTEM  WITH  LINEAR  SYSTEM  WITH  NONLINEAR 

GAINS  OPTIMAL  GAINS  OPTIMAL  GAINS  OPTIMAL  GAINS 


TABLE  3.4:  Comparison  of  Cost  Index  in  the  Presence  of  Nonlinearity 

at  Point  2 
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At  a  step  input  of  1.0,  the  initial  input  into  the  nonlinearity  was  1.0  multiplied 
by  the  k0  term.  Refer  to  Figure  3.11.  This  input  was  well  below  that  needed  to 
reach  the  nonlinear  region  of  saturation  and  had  no  effect  on  the  dynamic  response 
of  the  system.  The  cost  index  and  optimal  gains  remained  unchanged.  As  the 
step  input  was  raised  to  the  point  where  the  step  input  multiplied  by  ko  exceeded 
the  saturation  value  of  30.0,  nonlinear  effects  deteriorated  the  system’s  performance. 
Due  to  the  nonlinearity  remaining  in  saturation  for  longer  periods  of  time,  the  effects 
of  larger  step  inputs  were  more  dramatic  than  those  of  smaller  step  sizes.  In  general, 
the  presence  of  the  nonlinearity  caused  a  decrease  in  the  system’s  damping.  The 
decreased  damping  resulted  in  a  larger  overshoot  of  the  final  value  and  a  longer 
transient  period;  however,  the  general  shape  of  the  response  remained  constant. 
The  system  maintained  one  overshoot  and  one  undershoot.  The  change  in  the 
damping  had  dramatic  effects  on  the  relative  values  of  the  cost  index.  Even  with 
input  steps  causing  only  minor  amounts  of  saturation,  the  cost  index  doubled  from 
that  of  a  linear  system.  For  larger  step  inputs,  cost  indexes  of  at  least  an  order  of 
magnitude  higher  than  its  linear  counterpart  were  common.  This  result  was  to  be 
expected.  During  the  optimization  of  the  linear  system,  the  cost  index  penalized 
long  duration  errors  and  adjusted  the  feedback  gains  to  provide  as  fast  a  system  as 
possible.  The  introduction  of  the  nonlinearity  initially  limited  the  control  input  to 
30.0,  and  resulted  in  a  slower  system. 

Although  the  presence  of  the  saturating  element  caused  a  large  rise  in  the 
value  of  the  cost  index,  it  can  be  seen  from  Table  3.4  that  minimization  with  the 
nonlinearity  inserted  showed  relatively  little  change.  Even  for  large  amounts  of 
saturation,  the  cost  function  was  only  reduced  by  a  few  units.  In  congruence  with 
this  was  the  fact  that  the  nonlinear  optimal  gains  changed  very  little  from  the  linear 
optimal  gains.  Each  feedback  gain  increased  in  value  proportional  to  the  increase 
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in  the  step  input  with  the  higher-order  feedback  gains  increasing  at  a  faster  rate 
than  those  of  lower  orders.  In  terms  of  the  transient  response,  this  had  the  effect  of 
increasing  the  damping  coefficient  by  moving  the  dominant  complex  roots  farther 
into  the  left  half  of  the  complex  plane.  This  resulted  in  less  overshoot  and  a  smoother 
transient  response.  To  illustrate  this  phenomena,  the  step  responses  for  the  extreme 
case  of  saturation  caused  by  a  step  input  of  50.0  are  given  in  Figures  3.12,  3.13, 
and  3.14.  Figure  3.12  shows  the  typical  step  response  obtained  with  the  use  of 
this  cost  index.  This  illustration  is  for  linear  optimal  gains  with  a  linear  system. 
Figure  3.13  shows  the  effects  of  using  linear  optimal  gains  with  a  nonlinear  system. 
Note  the  increase  in  the  settling  time  and  maximum  percent  overshoot.  Figure  3.14 
shows  the  nonlinear  system  with  the  nonlinear  optimal  gains.  Both  overshoot  and 
transient  were  reduced.  Due  to  the  limit  on  the  control  input,  the  minimization 
only  nominally  reduced  the  settling  time.  The  majority  of  the  decrease  in  the  cost 
index  came  from  the  reduction  of  overshoot,  which  resulted  in  less  total  error. 
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Figure  3.12:  Linear  Step  Response,  Step=50.0,  X=Output 
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Figure  3.13:  Nonlinear  Step  Response  Using  Linear  Optimal  Gains, 

Step=50.0,  X=Output 
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Figure  3.14:  Nonlinear  Step  Response  Using  Nonlinear  Optimal  Gains, 

Step=50.0,  X=Output 
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Perhaps  a  better  understanding  of  the  dynamics  of  the  system  could  be  gained 
by  examining  Figures  3.15,  3.16,  and  3.17.  These  figures  correspond  to  the  systems 
described  for  Figures  3.12,  3.13,  and  3.14,  respectively.  In  these  figures,  the  cost, 
control  input,  and  error  were  plotted  as  a  function  of  time.  In  the  linear  system  of 
Figure  3.15,  no  saturation  occurred.  In  Figure  3.16,  it  was  clear  that  the  control 
input,  shown  by  the  curve  NLU,  remained  saturated  at  ±30.0  for  well  over  half  of 
the  transient  period.  After  nonlinear  minimization,  Figure  3.17  shows  that  the  new 
optimal  gains  reduced  the  total  saturation  time.  Figure  3.18  shows  the  effect  of  the 
nonlinear  optimal  gains  on  the  linear  system.  All  overshoots  and  undershoots  were 
eliminated. 
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Figure  3.15:  Linear  System;  U  =  Control  Input,  Cost  =  Value  of  Cost 

Index,  E  =  Error,  Step  =  50.0 
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Figure  3.16:  Nonlinear  System  with  Linear  Gains;  NLU  =  Control 
Input,  Cost  =  Value  of  Cost  Index,  E  =  Error,  Step  =  50.0 
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Figure  3.17:  Nonlinear  System  with  Nonlinear  Gains;  NLU  =  Control 
Input,  Cost  =  Value  of  Cost  Index,  E  =  Error,  Step  =  50.0 
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Figure  3.18:  Linear  System  with  Nonlinear  Optimal  Gains;  Step  =  50.0, 

X  =  Output 
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The  results  of  this  study  indicated  that  the  integral  of  time  multiplied  by  the 
absolute  value  of  the  error  remained  a  viable  design  tool  in  the  presence  of  saturation. 
The  optimal  feedback  gains  attained  through  a  linear  minimization  remained  near 
optimal  when  the  nonlinearity  was  introduced.  Realizing  the  decreased  damping 
brought  about  by  the  control  input  limit,  the  control  systems  engineer  could  lightly 
increase  the  feedback  gains  to  quickly  attain  the  desired  response. 

The  question  now  arises  as  to  the  effect  of  moving  the  nonlinearity  to  saturation 
point  1  in  Figure  3.10.  In  order  to  perform  the  simulations  of  this  new  system,  the 
nonlinear  element  of  Figure  3.9  was  moved  to  saturation  point  1  and  the  limits 
of  saturation  reset  to  ±5.0.  This  new  saturation  limit  was  used  in  order  that  the 
nonlinear  effects  could  be  observed  at  lower  step  inputs.  The  general  procedure  of 
the  simulation  remained  as  it  did  for  saturation  point  2. 

While  the  nonlinearity  at  saturation  point  2  served  to  reduce  the  damping, 
saturation  point  1  had  the  opposite  effect.  The  nonlinearity  at  point  1  served  to 
increase  the  damping  of  the  system.  The  resulting  values  for  various  step  inputs  are 
presented  in  Table  3.5.  At  the  step  input  of  5.0,  the  system  remained  in  the  linear 
region  of  operation  and  the  value  of  the  cost  index  and  optimal  gains  remained  con¬ 
stant  for  all  simulations.  As  the  step  input  exceeded  the  linear  area  of  operation, 
increased  damping  effects  were  seen  whose  magnitude  was  dependent  on  the  amount 
of  saturation  present.  This  increase  in  damping  resulted  in  greatly  reduced  over¬ 
shoot  of  the  steady-state  value  and  relatively  little  increase  in  the  transient  period. 
Generally,  the  resulting  system  maintained  a  smooth  transition  to  its  final  value. 
As  with  saturation  point  2,  point  1  had  dramatic  effects  on  the  relative  values  of 
the  cost  index.  For  an  input  of  5.0  units  over  the  saturation  value,  the  cost  index 
approximately  doubled  from  that  of  a  linear  system.  Though  there  was  no  linear 
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relationship  between  the  increase  in  the  cost  index  and  the  value  of  the  step  input, 
larger  step  inputs  caused  higher  values  for  the  cost  index. 


TABLE  3.5:  Comparison  of  Cost  Index  in  the  Presence  of  Nonlinearity 

at  Point  1 


STEP  NONLINEAR  COST  OF  LINEAR  COST  OF  NONLINEAR  COST  OF  NONLINEAR 

SIZE  OPTIMAL  GAINS  SYSTEM  WITH  LINEAR  SYSTEM  WITH  LINEAR  SYSTEM  WITH  NONLINEAR  I 

OPTIMAL  GAINS  OPTIMAL  GAINS  OPTIMAL  GAINS 


5.0 

to  =  20.831 

Jt,  =  4.280 

Jt,  =  0.206 

0.157 

0.157  „ 

0.159 

6.0 

ko  =  20.831 

ki  =  4.192 

ki  =  0.195 

0.188 

0.209 

0.208 

10.0 

ko  m  20.831 

Jt,  =  3.713 

Jt,  =  0.131 

0.319 

0.617 

0.526 

20.0 

Jbo  =  20.831 

ki  ss  2.902 

k-i  -  0.063 

0.628 

3.451 

2.239 

Although  the  presence  of  the  saturating  element  caused  a  large  rise  in  the  value 
of  the  cost  index,  Table  3.5  shows  that  minimization  with  the  nonlinearity  inserted 
gave  relatively  little  change  in  the  optimal  gains.  For  a  step  input  of  20.0,  causing  an 
initial  saturation  of  15.0,  the  cost  index  was  reduced  by  less  than  2.0  units.  In  order 
to  reduce  the  damping  and  increase  the  transient  time,  the  minimization  reduced 
the  values  of  the  feedback  gains.  In  terms  of  the  transient  response,  this  had  the 
effect  of  decreasing  the  damping  coefficient  by  moving  the  dominant  complex  roots 
closer  to  the  right  half  of  the  plane.  The  response  of  the  linear  system  with  a  step 
input  of  10.0  is  shown  in  Figure  3.19  and  shows  the  typical  transient  response  of  a 
system  designed  using  the  integral  of  time  multiplied  by  the  absolute  value  of  the 
error.  Figure  3.20  is  the  step  response  of  the  same  system  with  the  nonlinearity 
inserted.  The  saturation,  effectively,  slowed  the  system  down  and  resulted  in  less 
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overshoot  and  undershoot;  furthermore,  a  smoother  transition  to  steady  state  was 
noted.  In  Figure  3.21,  the  cost  index  was  minimized  with  the  nonlinearity  present. 
The  oscillatory  response  returned  due  to  a  lower  damping  coefficient  caused  by  the 
reduction  in  feedback  gains.  The  effect  of  these  new  feedback  gains  could  best  be 
seen  in  Figure  3.22  where  the  nonlinear  optimal  gains  were  used  with  the  linear 
system.  The  step  response  became  much  more  oscillatory  with  two  overshoots  and 
two  undershoots. 

The  effects  of  the  saturation  located  at  points  1  and  2  were  opposite.  Point 
1  caused  an  increase  in  damping,  while  point  2  caused  a  decrease  in  damping.  The 
nonlinear  optimal  gains  of  point  1  reduced  in  value  with  an  increase  in  step  size;  con¬ 
versely,  increases  in  gain  were  observed  at  point  two.  The  result  of  most  importance 
here  was  the  fact  that  the  presence  of  this  type  of  saturation  had  predictable  effects 
which  could  be  used  to  provide  the  needed  response.  As  an  example,  consider  that 
the  control  systems  engineer  desired  fast  response,  little  error,  and  no  overshoot; 
further,  there  was  some  sort  of  limiting  device  at  saturation  point  1.  The  engineer 
linearizes  the  system,  utilizes  the  integral  of  time  multiplied  by  the  absolute  value 
of  the  error  criterion,  and  obtains  his  desired  response.  Adjustment  of  the  system 
is  enhanced  by  the  knowledge  that  a  decrease  in  feedback  gains  allows  less  damping 
and  an  increase  in  feedback  gains  causes  more  damping. 
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Figure  3.19:  Linear  Step  Response,  Step  =  10.0,  X  =  Output 
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Figure  3.20:  Nonlinear  Step  Response  Using  Linear  Optimal  Gains, 

Step  =  10.0,  X  =  Output 
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Figure  3.21:  Nonlinear  Step  Response  Using  Nonlinear  Optimal  Gains, 

Step  —  10.0,  X  =  Output 
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Figure  3.22:  Linear  Step  Response  Using  Nonlinear  Optimal  Gains, 

Step  =  10.0,  X  =  Output 
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IV.  STANDARD  FORMS 


Chapter  II  presented  the  standard  forms  derived  by  Graham  and  Lathrop 
[Ref.  1]  and  based  on  the  integral  of  time  multiplied  by  the  absolute  value  of  error. 
These  standard  forms  were  based  on  their  simulations  of  linear  systems  on  an  analog 
computer  which,  at  the  time,  was  the  most  convenient  computing  device.  Their  work 
started  by  normalizing  the  closed-loop  transfer  function  of  the  linear  system  to  be 
optimized  to  the  form 

C(S )  AmSm  +  Am.1Sm-1  +  ---A1S  +  1 

R(S)  SN  +  +---B,S  + 1  '  1  ] 

In  this  normalized  form,  the  coefficients  of  the  first  and  last  terms  of  the  denominator 
were  unity. 

Each  coefficient  of  the  normalized  transfer  function  was  then  varied  separately 
until  the  value  of  the  cost  index  became  a  minimum.  The  coefficients  obtained  at  the 
minimum  value  of  the  cost  index  were  considered  to  be  the  optimum  parameters. 
These  optimum  parameters  became  the  basis  for  their  standard  forms.  Though 
their  work  was  widely  heralded  as  a  success,  they  were  personally  disappointed  by 
their  failure  to  find  a  progressive  root  pattern.  Since  their  work,  the  development 
of  advanced  techniques  in  simulation  analysis  along  with  a  wealth  of  numerical 
optimization  algorithms  have  provided  more  efficient  and  effective  methods  to  study 
the  problem.  In  this  chapter,  these  advanced  methods  were  used  to  derive  and  study 
a  new  set  of  standard  forms. 

The  investigations  dealt  with  type-1  plants  which  utilized  full-state  feedback. 
The  closed-loop  transfer  function  could  be  written  as 


N 


C(S)  _ _ 

R(S)  SN  +  A^0SN~l  +  ---AN^-1+^  ’ 


(4.2) 
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where  N  and  u>0  denoted  the  order  and  angular  frequency  of  the  system;  A\ . . .  A^-i 
were  the  transfer-function  coefficients.  To  facilitate  problem  manipulation  and  ease 
computational  tasks,  all  systems  were  considered  to  have  an  angular  frequency  of 
1.0  radian/second.  This  allowed  Equation  4.2  to  be  re-written  as 

m= _ L2 _  ,43) 

R(S)  sn  +  a,sn-'  +  ---an-1s  +  i.o  '  y  l 

Using  a  unity-feedback  loop  to  provide  the  error  signal,  the  transfer  function  of  the 
plant  became 


GP(S)  = 


1.0 

sN  +  a1s»-'  +  ---an.1s 


(4.4) 


The  unity-feedback  system  was  modeled  using  the  Dynamic  Simulation  Language 
and  coupled  with  the  minimization  algorithm.  [Ref.  3]  The  unit  step  was  used  as 
the  test  input.  In  most  cases,  the  coefficients  of  the  Butterworth  standard  forms 
served  as  the  initial  guesses  to  start  the  optimization  process.  The  settling  time 
was  calculated  for  each  system  and  used  as  the  time  interval  for  minimization.  The 
optimum,  normalized  transfer  function  coefficients  of  each  model  resulted  from  the 
iterative  computations  performed.  Standard  forms  for  the  first-  through  seventh- 
order  systems  were  derived. 

What  was  expected  was  roughly  the  same  coefficients  as  Graham  and  Lathrop 
found,  only  with  improved  accuracy.  This  was  the  case  for  the  initial  minimization 
results  which  are  presented  in  Table  4.1. 
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TABLE  4.1:  Minimization  #1;  Minimum  ITAE  Standard  Forms 


3  +  U>0 

» 2  +  1.42we«  +  u>l 
33  +  1.74 u097  +  2.15o>2«  +  w 3 
s 4  +  1.87wea3  +  3.29u7s7  +  2.61u;3«  +  u* 

3s  +  2.09a>e«<  +  4.47u£a3  +  4.68u>3«2  +  3.25w<J  +  w* 
s 6  +  2.81w0j5  +  6.27 u>y  +  8.22w3a3  +  7.42 u*s7  +  3.98 u>3s  +  w® 

37  +  4.41  U>036  +  9.67 U735  +  15.06o>3«<  +  15.50w<s3  +  11.03w*s2  +  4.81w«3  +  u>70 
38  +  5.02 u0s7  +  12.09w?a6  +  21.31u>335  +  25.85w<a<  +  22.91w*a3  +  14.01u;«32  +  5.40wJ«  +  w® 


Comparing  Table  4.1  with  Graham  and  Lathrop’s  standard  forms  as  presented  in 
Table  2.1  in  Chapter  II,  the  coefficients  were,  essentially,  the  same.  The  minor 
differences  were  attributed  to  the  greater  accuracy  of  the  digital  computer  and 
minimization  algorithm.  The  results  of  Table  4.1  were  obtained  using  step  sizes 
on  the  order  of  0.1  in  the  minimization  search.  These  small  steps  closely  resembled 
the  continuous  nature  of  the  analog  computer  used  by  Graham  and  Lathrop. 

The  minimization  was  then  repeated  with  larger  step  sizes.  Surprising  results 
were  obtained.  Although  the  coefficients  of  the  lower-order  systems  (first-  through 
fourth-order)  remained  unchanged,  the  higher-order  systems  showed  drastic  changes 
which  could  not  be  attributed  to  the  increased  accuracy  of  the  digital  computer.  The 
revised  standard  forms  are  presented  in  Table  4.2. 
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TABLE  4.2:  Minimization  #2;  Minimum  ITAE  Standard  Forms 


3  +  Wp 

3 7  +  1A2u03  + 

a3  +  1.74u>0a2  +  2.15w2a  +  w3 
a4  +  1.87wea3  +  3.29w2a2  +  2.61w3a  +  u* 

■  a5  +  1.93u>0a'1  +  4.3&^a3  +  4.52u3a2  +  3.22 ^*s  +  w* 
a6  -J-  1  .Glcv^a3  4"  5.28u>2a^  4"  5.87cv3a3  4"  6.43w^a3  4"  3.54u^a  4“ 
a7  4-  1.59u0a6  4-  6.37w2a5  4-  7.57w3a<  4-  10.85w^a3  4-  7.82w*a2  4-  4.19w®a  4-  u>70 


Wlicn  comparing  the  new  standard  forms  with  the  original  forms  of  Table  4.1,  large 
changes  were  seen  in  the  fifth-  through  seventh-order  systems.  Clearly,  Graham  and 
Lathrop  found  only  a  local  minimum  for  these  higher-order  systems.  To  quantify 
the  reduction,  the  value  of  the  cost  index  was  calculated  for  all  systems  of  Table  4.1 
and  compared  with  the  revised  systems  of  Table  4.2.  The  results  are  presented  in 
Table  4.3. 
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TABLE  4.3:  Value  of  Relative  Cost  Indexes 


SYSTEM 

ORDER 

COST 

MINIMIZATION  #1 

COST 

MINIMIZATION  #2 

SETTLING 

TIME 

1 

18.000 

18.000 

6 

2 

1.936 

1.936 

8 

3 

3.085 

3.085 

11 

4 

4.512 

4.512 

12 

5 

6.227 

6.201 

14 

6 

8.761 

8.251 

15 

7 

13.082 

10.676 

20 

While  the  first-  through  fourth-order  costs  remained  constant,  increasingly  lower 
costs  were  realized  as  the  system’s  order  was  increased.  The  largest  decrease  in  cost 
was  for  the  seventh-order  system,  as  its  cost  went  from  13.1  units  to  approximately 
10.7  units. 

The  failure  of  Graham  and  Lathrop  to  find  the  absolute  or  global  minimum 
thwarted  their  effort  to  find  a  progressive  or  predictable  root  pattern.  The  revised 
root  locations  for  the  third-  through  seventh-order  systems,  as  plotted  in  Figure  4.1, 
show  a  definitive  pattern. 
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Figure  4.1:  Root  Locations  for  Systems  of  TABLE  4.2  Plotted  on  the 

S-Plane 
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In  general,  the  optimum  systems’  roots  tended  to  move  closer  toward  the  imaginary 
axis  as  the  order  of  the  system  was  increased.  All  even-ordered,  optimum-system 
poles  were  complex  conjugates,  as  was  the  case  with  the  second-,  fourth-  and  sixth- 
order  systems.  All  odd-ordered  optimum  systems  had  one  real  root  which  was 
always  the  furthest  distance  from  the  origin,  and  the  rest  of  the  roots  were  complex 
conjugates.  It  was  found  that  the  closer  the  conjugate  roots  were  to  the  imaginary 
axis,  the  larger  their  imaginary  values;  moreover,  it  was  found  that  all  of  the  roots 
were  evenly  spaced  on  an  arc  running  between  the  two  conjugate  roots  having  the 
greatest  absolute  imaginary  value.  Though  the  results  seemed  to  indicate  a  definite 
configuration,  no  geometric  pattern  was  established. 

The  optimal  systems  obtained  in  Table  4.2  resulted  in  step  responses  possessing 
similar  characteristics.  Figure  4.2  shows  the  step  responses  for  the  first-  through 
seventh-order  systems. 
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Figure  4.2:  Step  Response  of  Optimal  Systems  of  TABLE  4.2 
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time  in  sec 


All  of  these  systems  had  fast  responses,  negligible  over  and  undershoots,  and  fast 
rates  of  decay. 

In  reference  to  Table  4.2,  it  may  be  observed  that  the  natural  frequency  of  every 
system,  approximated  by  u>0,  appeared  in  the  standard  forms  as  a  literal  quantity. 
No  attempt  was  made  to  optimize  the  system  with  respect  to  o>o-  It  should  be 
noted  that  the  value  of  the  integral  of  time  multiplied  by  the  absolute  value  of  the 
error  was  affected  by  varying  u0.  In  fact,  the  value  of  the  cost  index  decreased 
with  increasing  u>o-  This  indicated  that  the  largest  possible  value  of  ujq  should  be 
used  in  follower-type  systems.  In  terms  of  the  S-plane,  this  meant  that  the  radial 
distance  from  the  origin  to  the  roots  of  the  characteristic  equation  increased  with 
larger  values  of  uo-  Figure  4.3  shows  the  movement  of  roots  away  from  the  origin  of 
the  S-plane  as  u>o  was  increased  from  1.0  to  2.0,  4.0,  6.0,  8.0,  and  10.0.  Realistically, 
practical  considerations  set  an  upper  limit  on  the  natural  frequency  and,  thus,  upon 
the  frequency  of  u>o- 
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-20.0  -10.0  -12,0  -8.0  —4.0  0.0  4.0  0.0  12.0  10.0  20.0 


Figure  4.3:  Root  Movement  for  a  Seventh-Order  System  as  a  Function 

of  U>o 
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The  usefulness  of  these  standard  forms  was  best  illustrated  by  examples.  Con¬ 


sider  the  system  of  Figure  4.4. 


Figure  4.4:  Block  Diagram  of  System 


where  Gc(5)  is  a  cascade  compensator  and  GP(S )  is  the  plant  function  given  as 


1.0 


G'(s)  5(1.0  +  0.15)(1.0  +  S)  ' 


(4.5) 


Assuming  that  the  system’s  order  was  to  be  maintained  and  that  no  new  roots 
were  to  be  introduced,  the  standard  forms  of  Table  4.2  gave  the  closed-loop  transfer 
function  as 


Since 


then 


C(5) _ u| _ 

R{S)  s3  +  1.74u>o*?2  +  2.15u;o5  +  u>o 

CjS)  _  Ge(S)Gp(S) 

MS)  clK  ’  1  +  GC(S)GJS)  ’ 


Gci(S) 


OJn 


Ge(S)Gp(S)  Geq(S)  1_Ge{^  s(S2  +  1.74wft5  +  2.15wg) 
Solving  for  GC(S ), 


GC(S )  = 


GC(S)GP(S )  ug(1.0  +  0.1S)(1.0  +  S) 


GP(S) 


S2  +  1.74u>0S  +  2.15u>£  ' 


(4.6) 


(4.7) 


(4.8) 


(4.9) 


65 


If,  based  on  the  system’s  application,  u>0  was  chosen  to  be  10.0  radians/second,  then 


Gc(S)  = 


1000.0(1.0  +  0.1S)(1.0  +  «) 

52  +  17.45  +  215.0 


(4.10) 


Dividing  the  denominator  polynomial  by  the  numerator  polynomial  and  factoring, 
the  more  easily  realizable  form  of  Equation  4.11  was  obtained. 


GC(S)  = 


100.0 

1  I  6.4S+205.0 
1  T  S^  +  ll.OS+lO.O 


100.0 


1  +  F'{S) 

The  block  diagram  of  the  cascade  compensation  is  depicted  in  Figure  4.5. 


(4.11) 


Figure  4.5:  Block  Diagram  of  Cascade  Compensator 


What  remained  was  to  realize  the  compensator  in  hardware.  The  quantity  FC(S) 
was  rewritten  as 


Fc(S)  = 


which  was  broken  into 


and 


20.5(1.0  +  0.035) 

(1.0 +  5)(1.0  + 0.15)  ’ 

1 


Fci(S)  = 


fc2(S)  = 


1.0  +  5 

20.5(1.0  +  0.035) 
1.0  +  0.15 


(4.12) 


(4.13) 


(4.14) 
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Equation  4.13  was  realized  using  the  network  of  Figure  4.6. 


r2 


Figure  4.6:  Network  of  $  =  -Kl(1^aCS) 

Choosing  values  of  i?i  =  i?2  =  1.0  M Cl  and  C  =  1.0  (if  provided  Equation  4.13.  To 
realize  Equation  4.14,  the  network  of  Figure  4.7  was  used. 


Figure  4.7:  Network  of  $  = 
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Choosing  R\  =  32.0  KCl,Ri  =  1.0  MCl,Ci  =  1.0  /i/,  C?  =  0.1  /i/,  and  adding  two 
potentiometers  in  order  to  provide  the  best  possible  fit,  a  possible  compensation 
network  was  realized  in  Figure  4.8.  [Ref.  6:  pp.  86-149] 


Figure  4.8:  Possible  Compensation  Network 

The  key  point  here  was  not  the  hardware  implementation  of  the  compensator,  but 
the  fact  that  one  could  arrive  at  a  design  that  would  minimize  the  given  cost  index 
based  solely  on  the  use  of  the  standard-form  table. 

The  standard  forms  of  Table  4.2  can  most  easily  be  applied  with  the  use  of 
full-state  feedback.  Consider  the  system  of  Figure  4.9. 
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Figure  4.9:  7^-Order  System  with  Full  State  Feedback 
After  block  diagram  reduction,  the  system’s  transfer  function  was  found  to  be 


C(S)  _  _ lOO.Ofco _ 

R(S)  "  a7  +  (7.5  +  100Jk6)S6  +  (21.8  +  100.0Jt5)a5  +  (30.63  +  100.0A:4)S« 


+(21.75  +  100.0Jt3)S3  +  (7.5  +  100.0Jt2)S2  +  (1  +  100.0^  )S  +  100.0Jt0 

From  Table  4.2,  the  standard  form  for  a  seventh-order  system  was 

C.E.  =  S,+  1.59u>oSe+6.37w2Ss47.57u>JS<+10.85w2S3+7.82u>SS!+4.19u>SS+u>2  . 

(4.16) 

The  bandwidth  of  the  system  was  arbitrarily  set  at  5.0  radians/second.  By  equating 
coefficients  of  the  system’s  characteristic  equation  to  those  of  the  standard  form 
given  in  Equation  4.16,  the  optimal  values  were  found  to  be  k$  =  0.0045,  k$  =  1.37, 
k4  =  7.16,  k3  =  67.60,  k3  =  244.30,  k j  =  654.68  and  k0  =  781.25.  Substituting  these 
values  into  Equation  4.15,  the  transfer  function  became 
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C(S)  _  78125.00 

R(S)  “  S7  +  7.95 56  +  159.255s  +  946.255*  +  6781.2553  +  24437.55*  +  65468.755  +  78125.00  ' 

(4.17) 

Using  the  standard  forms  developed  by  Graham  and  Lathrop,  the  optimal 
gains  were  k$  =  0.15,  k$  =  2.39,  k+  =  18.54,  k 3  =  96.91,  322.43,  ki  =  715.62 

and  k0  =  781.25.  Substituting  these  values  into  Equation  4.15,  the  transfer  function 
became 

C(S)  =  _ 78125.00 _  . 

R(S)  S7  +  22.405®  +  260.505®  +  1885.0054  +  9712.5053  +  33250.005*  +  71562.505  +  78125.00  '  1  ‘ 


A  comparison  of  the  step  responses  of  the  two  systems  is  presented  in  Figure 
4.10.  Clearly,  the  feedback  gains  derived  from  the  standard  forms  of  Table  4.2 
provided  a  more  optimal  response  than  those  derived  from  Graham  and  Lathrop’s 
efforts.  The  revised  system  had  a  faster  rise  time,  less  over  and  undershoot,  and  a 
faster  rate  of  decay. 
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Figure  4.10:  Comparison  of  Optimal  Step  Responses 
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Time  in  seconds 


V.  THE  EFFECT  OF  PENALIZING  THE  USE 

OF  CONTROL 


A.  INTRODUCTION 

The  performance  indices  considered  thus  far  assumed  the  availability  of  un¬ 
limited  control  input  into  the  plant.  Realistically,  this  is  never  the  case  and  this 
limitation  must  be  considered  in  any  performance  index  utilized  to  optimize  a  sys¬ 
tem.  Failure  to  do  so  often  results  in  ridiculously  high  input  values  which  cannot 
be  attained  by  current  technology;  furthermore,  the  financial  cost  involved  in  the 
hardware  implementation  of  the  design  must  be  considered.  Higher  control  input 
necessitates  correspondingly  large,  complex,  and  expensive  system  components.  An 
economical  system  contains  the  lowest  cost  components  possible  to  accomplish  the 
task  and  utilizes  these  components  to  their  full  capacity.  This  philosophy  indicates 
that  the  system  is  to  be  driven  at  its  saturation  limits  to  economically  utilize  its 
capabilities. 

One  of  the  most  widely  used  linear-design  techniques  is  the  optimal  linear 
quadratic  regulator.  A  simplified  version  of  this  criterion  is  to  find  the  control  such 
that  the  performance  index 

J  =  J  [e2(t)  -I-  gu2(t)]  dt  (5.1) 

is  minimized,  where  q  is  a  weighting  factor  reflecting  the  relative  importance  or 
cost  of  control  as  compared  to  that  of  the  system’s  total  error.  [Ref.  6:p.  340] 
The  squaring  of  the  terms  reflect  that  it  is  the  total  error  and  control  which  are  of 
importance,  regardless  of  the  relative  direction  of  these  values.  This  cost  index  has 
been  well  studied  and  analytical  solutions  formulated. 
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As  discussed  in  Chapter  I,  the  cost  functional  of  the  integral  of  time  multiplied 
by  the  absolute  value  of  error  resulted  in  a  system  with  a  generally  acceptable 
transient  response.  Based  on  this  favorable  response,  the  question  arose  as  to  what 
effect  did  the  addition  of  a  control  cost  to  the  index  have  on  the  system’s  transient 
response.  It  was  the  purpose  of  this  section  to  answer  this  question.  In  particular, 
the  investigation  centered  on  the  performance  index  of  Equation  5.2, 

J  =  J  \t  |e(f)|  +gu2(t)]  dt  (5.2) 

where  q  was  a  relative  weighting  factor,  u(t)  was  the  actual  control  input,  t  was  time, 
and  e(t)  was  the  error  between  the  reference  input  and  the  actual  system  output. 
The  nonlinear  nature  of  Equation  5.2  eliminated  an  analytical  solution;  therefore, 
it  was  analyzed  using  simulation  techniques. 


B.  LINEAR  OPTIMIZATION 

The  cost  index  of  Equation  5.2  was  minimized  for  both  a  third-  and  fourth- 
order  plant  utilizing  full-state  feedback.  The  transfer  function  for  the  third-order 
plant  was 

G’(5)  "  53  +  3.053  +  2.05  ’  (5'3) 

and  the  transfer  function  for  the  fourth-order  plant  was 


GP(S)  = 


10.0 

S4+  8.5S3+ 16.0S2  + 6.0.9  ' 


(5.4) 


A  general  block  diagram  of  the  system  is  presented  in  Figure  5.1. 

In  Chapter  III,  it  was  necessary  to  set  the  zero-derivative  feedback  gain  to 
a  fixed  value  in  order  for  the  cost  index  of  time  multiplied  by  the  absolute  value 
of  the  error  to  converge  to  some  minimum  value.  With  the  addition  of  the  u2(t) 
term  in  the  cost  index,  this  step  was  no  longer  necessary.  This  added  constraint  on 
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Figure  5.1:  Block  Diagram  of  System  To  Be  Minimized  Using 
/  [t  |e(t)|  +9«2(01 dt 

the  amount  of  control  used  did  not  allow  the  minimization  routine  to  use  unlimited 
control  to'  speed-up  the  system.  There  was  a  minimum  value  of  the  cost  index 
based  on  a  compromise  between  the  speed  of  the  system  and  the  amount  of  control 
used.  This  compromise  was  greatly  affected  by  the  value,  chosen  by  the  designer, 
of  the  weighting  factor,  q.  Unfortunately,  there  was  no  magical  value  for  q.  It  was, 
usually,  arbitrarily  chosen  based  on  the  components  available  in  the  system  and  the 
application  for  which  the  system  was  to  be  used. 

Although  it  was  not  necessary  to  set  the  value  of  the  zero-derivative  feedback 
gain,  the  systems  studied  were  minimized  for  both  a  fixed  gain  and  a  variable  one. 
Zero-derivative  feedback  gains  were,  arbitrarily,  chosen  at  20.83  and  1000.00  for  the 
third-  and  fourth-order  systems,  respectively.  The  results  of  the  fixed  gain  cases  are 
presented  in  Tables  5.1  and  5.2  for  the  third-  and  fourth-order  systems.  In  both 
systems,  trends  were  clearly  evident.  For  the  fixed  gain,  increases  in  the  weighting 
of  the  control  cost  caused  the  optimal  feedback  gains  to  increase.  This  increase 
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in  feedback  gains  caused  the  complex  roots  to  retract  to  the  real  axis  and  all  real 
roots  to  increase  in  absolute  value.  With  all  real  roots,  the  system  exhibited  an 
exponential  rise  to  steady  state;  however,  it  should  be  noted  that  relatively  high 
values  of  q  were  used  to  force  the  roots  to  the  real  axis.  In  the  case  of  the  fourth- 
order  system  under  study,  a  weighting  factor  of  100.0  was  required.  In  most  practical 
applications,  this  large  of  a  weighting  on  control  cost  is  not  used  by  the  designer. 
With  the  zero-derivative  feedback  gain  variable,  most  of  the  reduction  in  the  value 
of  the  performance  index  came  from  a  reduction  in  the  control  cost.  Since  the 
control  to  the  plant  was  the  fixed  value,  ko ,  multiplied  by  the  plant  gain  and  minus 
the  derivative  feedback,  the  feedback  gains  were  increased  to  lower  the  plant  input; 
consequently,  the  cost  of  control  was  reduced.  As  the  value  of  the  weighting  index, 
q ,  was  increased,  the  value  of  the  cost  functional  increased.  This  indicated  that 
the  system  was  increasingly  less  capable  of  handling  the  compromise  between  the 
control  cost  and  time  multiplied  by  the  absolute  value  of  the  error.  Due  to  the  fixed 
forward-path  gain  of  the  system  and  the  squaring  of  the  control  cost,  the  system 
slowed  rapidly  for  even  small  values  of  q.  Figure  5.2  shows  the  third-order  system’s 
step  responses  for  various  values  of  q. 


75 


TABLE  5.1:  Optimizing  the  Third-Order  System,  k 0  Fixed  at  20.83 


VALUE  OF  q 

OPTIMAL 

PARAMETERS 

VALUE  OF 
COST  INDEX 

ROOT 

LOCATIONS 

0.0 

kQ  =  20.83 
kr  =  4.48 
k2  =  0.31 

0.03 

-7.34 

-5.28  ±;10.41 

0.1 

ko  —  20.83 
k\  =  10.90 
k2  =  2.55 

0.40 

-121.13 
-2.13  ±j  1.92 

0.5 

ko  =  20.83 
ki  =  15.31 
k2  =  4.92 

0.92 

-236.06 
-1.55  ±;1.35 

1.0 

ko  —  20.83 
kj.  =  18.78 
k2  =  7.48 

1.28 

-359.54 
-1.25  ±j  1.10 

2.0 

ko  =  20.83 
k2  =  22.94 
k2  =  11.97 

1.76 

-575.65 
-0.96  ±;0.91 

5.0 

ko  —  20.83 
k\  =  33.48 
k2  =  25.60 

3.04 

-1230.49 
-0.65  ±;0.62 
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TABLE  5.2:  Optimizing  the  Fourth-Order  System,  fco  Fixed  at  1000.0 


VALUE  OF  « 

OPTIMAL 

MINIMIZATION 

ROOT 

PARAMETERS 

PERIOD 

LOCATIONS 

to  =  1000.00 

0.0 

l,  =  263.00 

4.0 

-4.01  ±>12.97 

tj  =  31.80 
is  =  1.15 

-5.98  ±j  4.30 

k0  =  1000.00 

*503.60 

0.1 

*1  =  048.00 

5.0 

*4.03 

l,  =  376.00 
is  =  50.00 

*1.72  ±jl.40 

to  =  1000.00 

*665.35 

0.5 

ii  =  1130.00 

6.0 

*5.58 

i,  =  542.00 

*1.29  ±j\M 

is  =  66.40 

to  =  1000.00 

-752.68 

1.0 

k ,  =  1220.00 

6.0 

-6.03 

l,  =  628.00 
is  =  75.10 

-1.17  ±;0.92 

to  =  1000.00 

-845.16 

2.0 

i,  =  1320.00 

10.0 

-6.03 

l,  =  720.00 
is  =  84.40 

*1.07  ±;0.84 

to  =  1000.00 

*975.00 

5.0 

ii  =  1450.00 

15.0 

-6.70 

i,  =  845.00 
is  =  97.30 

-0.9995  i;  0.733 

io  =  1000.00 

-1063.90 

10.0 

ii  =  1550.00 

15.0 

-6.81 

l,  =  929.00 
is  =  106.00 

-0.97  ±/0.66 

i0  =  1000.00 

*1377.80 

100.0 

ii  =  2110.00 

15.0 

-6.41 

i,  =  1190.00 

*1.41 

is  =  138.00 

*0  81 

i0  =  1000.00 

*1613.40 

1000.0 

ii  =  2560.00 

15.0^ 

*6.07 

l,  =  1370.00 

-1.92 

is  =  161.00 

-0.53 

i0  =  1000.00 

*1639.60 

2000.0 

i,  =  2610.00 

15.0 

*6.03 

l,  =  1390.00 

-1.96 

is  =  164.00 

-0.52 
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Figure  5.2:  Step  Responses  for  Various  Values  of  q ,  Third-Order  System 
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TIME  IN  SEC 


Tables  5.3  and  5.4  show  the  results  of  the  third-  and  fourth-order,  variable-gain 
systems.  For  weighting  factors  of  less  than  or  equal  to  1.0,  all  of  the  feedback  gains 
were  reduced.  This  resulted  in  both  the  complex  and  real  roots  being  reduced.  For 
weighting  factors  in  excess  of  1.0,  this  trend  ceased;  moreover,  the  feedback  gains 
optimized  to  more  random  patterns.  A  trend  which  did  remain  constant  throughout 
the  range  of  control  weightings  was  the  relative  values  of  the  feedback  gains.  In  the 
fourth-order  system  of  Table  5.4,  the  kl  feedback  gain  remained  the  largest  value, 
followed  by  the  ko,  k2,  and  k3  feedback  gains.  Unlike  the  fixed  gain  systems,  the 
complex  roots  of  the  variable-gain  systems  never  returned  to  the  real  axis;  however, 
the  complex  roots  did  progressively  decrease  in  value.  Since  an  increase  in  the 
control  weighting  translated  to  less  power  being  supplied  to  the  plant,  the  result 
was  a  slower  response.  To  accomplish  this  reduction  in  speed,  the  dominant  roots 
became  smaller  in  value.  Since  the  natural  frequency  was  measured  as  the  radial 
distance  from  the  origin  of  the  s-plane  to  the  complex  roots,  this  reduction  in  the 
absolute  value  of  the  dominant  roots  implied  a  reduction  in  the  bandwidth  of  the 
system.  In  an  attempt  to  find  a  definitive  root  pattern  to  which  the  roots  converged, 
control  weightings  up  to  and  including  10,000.00  were  used.  No  progressive  patterns 
were  found.  As  with  the  fixed-gain  systems,  increasing  values  of  q  caused  increasing 
values  of  the  performance  index. 
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TABLE  5.3:  Optimizing  the  Third-Order  System  with  ko  Variable 


VALUE 
OF  f 

OPTIMAL 

PARAMETERS 

VALUE  OF 
COST  INDEX 

OPTIMAL 

ROOTS 

SYSTEM 

BANDWIDTH** 

0.0 

(Will  not 
converge) 

0.1 

k0  ~  3.310 
=  1.380 
*3  =  0.180 

0.178 

F.T.  =  4.0* 

-3.62  ±;4.83 
-4.37 

5.42 

0.5 

k0  =  1.420 
=  0.753 
*2  =  0.114 

0.284 

F.T.  =  4.0* 

-2.63  ±;3.78 
-3.22 

4.09 

1.0 

k0  =  1.052 
=  0.612 
*j  =  0.099 

0.349 

F.T.  =  4.0* 

-2.41  ±i3.37 
-2.94 

3.69 

20 

k0  =  0.754 
*1  =  0.480 

tj  =  0  081 

0.430 

F.T.  =  4.0* 

-2.14  ±j3.06 
-2.60 

3.30 

5.0 

k0  =  0.502 
=  0.356 
*2  =  0.062 

0.569 

F.T.  =  4.0* 

-1  86  ±;2.68 
-2.27 

2.88 

10.0 

to  =  0.356 
t,  =  0.274 
lj  =  0.048 

0.773 

F.T.  =  4.0* 

-1.66  ±;2.39 
-2.01 

2.59 

100.0 

to  =  0.121 
li  =  0.112 

tj  =  0.015 

1.610 

F.T.=4.0* 

-1.16  ±jl.66 
-1.41 

1.79 

1000.0 

k0  =  0  034 
*1  =  0.023 
h  =  -0.016 

3.70 

F.T.=10.0* 

-0.70  ±>1.21 
-0.84 

1.77 

2000.0 

to  =  0.025 
t,  =  0.012 
lj  =  -0.017 

4.98 

F.T.=  10.0* 

-0.68  ±>1.00 
-0.84 

1.06 

5000.0 

*o=  0.020 
*i=  0.005 
*3=  -0.006 

7.50 

F.T. =20.0* 

-0.48  ±  j0.55 
-1.74 

0.99 

10000.0 

kQ  =  0.009 

*i  =  0.002 

*2  =  -0.025 

10.10 

F.T.=30.0* 

-0.77  ±>1.04 
-0.27 

0.76 

*  Finishing  Time  (F.T.)  or  integration  time  over  which  the  system  was  minimized 

units=seconds. 

**The  system  bandwidth  was  approximated  by  the  u The  value  of  u>0  was 
defined  as  shown  in  the  standard  forms  of  Table  2.2. 
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TABLE  5.4:  Optimizing  the  Fourth-Order  System  with  k0  Variable 


VALUE 
OF  q 

OPTIMAL 

PARAMETERS 

VALUE  OF  COST 
INDEX  F.T.=10.0  SEC* 

OPTIMAL 

ROOTS 

SYSTEM 

BANDWIDTH 

0.0 

(Will  not 
converge) 

0.1 

Jfco  =  5.366 
Jfc,  =  6.591 
Jfc2  =  2.382 
Jfc3  =  0.361 

1.586 

-8.23 

-1.48 

-1.19  ±jl.73 

2.71 

0.5 

Jfc0  =  2.482 
Jfc,  =  3.551 
t2  =  1.293 
Jfc3  =  0.226 

2.594 

-10.27 

-1.14 

-0.93  ±jl.31 

2.34 

1.0 

Jfc0  =  1.705 
Jfc,  =  2.593 
Jfc2  =  0.852 
Jfc3  =  0.145 

3.242 

-6.47 

-1.09 

-0.91  ±jl.l9 

1.99 

5.0 

Jfco  =  1.201 
Jfc,  =  2.345 
Jfc2  =  1.292 
Jfc3  =  0.627 

5.724 

-14.83 

-1.27 

-0.59  ±j0.63 

1.93 

10.0 

Jfco  =  1.075 
Jfc,  =  2.368 
Jfc2  =  1.677 
Jt3  =  1.044 

7.545 

-17.13 

-0.68 

-0.57  ijO.78 

1.81 

100.0 

Jfco  =  0.279 
Jfc,  =  0.560 
Jfc2  =  0.456 
Jfc3  =  0.666 

20.190 

-13.72 

-0.63 

-0.40  ijO.40 

1.29 

1000.0 

Jfco  =  0.149 
Jfc,  =  0.424 
Jfc2  =  1.212 
Jfc3  =  1.074 

68.45 

F.T. =20  sec* 

-17.68 

-1.12 

-0.23  ±j0.16 

1.10 

*  Finishing  Time  (F.T.)  or  integration  time  over  which  the  system  was  minimized. 
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Two  problems  inherent  to  the  cost  index  were  found  while  investigating  the 
variable-gain  systems.  These  problems  were  due  to  the  mathematical  formulation 
of  the  index.  Although  the  index  considered  the  duration  of  the  total  error  and 
the  amount  of  control  used,  it  did  not  equally  weight  these  conflicting  values.  The 
duration  and  amount  of  error  was  found  by  multiplying  time  by  the  absolute  value 
of  the  error;  on  the  other  hand,  the  control  cost  was  found  by  squaring  the  control 
input.  The  difference  between  the  squared  value  and  the  multiplied  value  required 
that  a  long  minimization  period  be  used  during  the  system’s  optimization.  If  this 
procedure  was  not  followed,  an  optimal  solution  could  not  be  assured.  This  problem 
is  best  shown  by  an  example.  Consider  the  fourth-order  plant  of  Equation  5.4.  Prior 
to  optimization,  the  random  feedback  gains  were  ko  =  1000.0,  kj  =  263.0,  k 2  =  31.8, 
and  k3  =  1.15.  With  these  gains,  the  response  of  Figure  5.3  was  obtained.  This 
system  had  a  settling  time  of  approximately  two  seconds.  The  system  was  then 
optimized  using  the  performance  index  of  Equation  5.2.  Using  a  control  weighting 
factor  of  5.0  and  minimization  periods  of  2.0,  4.0,  6.0,  and  10.0  seconds,  the  optimal 
step  responses  of  Figure  5.4  were  obtained.  As  can  be  seen  from  the  figure,  different 
optimal  responses  were  obtained  for  each  minimization  period.  As  the  minimization 
or  integration  period  was  increased,  the  step  response  became  more  optimal.  This 
dependence  was  also  seen  in  the  optimal  feedback  gains.  The  optimal  feedback  gains 
and  the  values  of  the  cost  functional  for  a  10.0  second  simulation  are  shown  in  Table 
5.5.  As  the  minimization  period  was  increased,  the  value  of  the  cost  index  was 
decreased;  furthermore,  the  feedback  gains  moved  closer  to  their  optimal  values. 
The  problem  was  magnified  as  the  value  of  the  control  weighting  was  increased. 
Progressively  longer  minimization  periods  were  required  to  ensure  a  truly  optimal 
solution.  The  explanation  of  this  phenomenon  was  straightforward.  For  short  time 
periods  and  larger  control  weightings,  the  minimization  routine  realized  the  most 


82 


cost  savings  by  cutting  the  mathematically  favored  control  cost.  This  artificial 
optimal  solution  could  only  be  corrected  by  increasing  the  integration  period  over 
which  the  problem  was  solved.  For  a  given  control  weighting,  there  was  no  exact  way 
of  predicting  the  required  minimization  period  needed  to  optimize  the  system.  The 
only  solution  was  to  steadily  increase  the  solution  time  until  no  further  reductions 
in  cost  were  realized.  For  the  systems  under  study,  large  multiples  of  the  original 
system’s  settling  time  were  used. 


Figure  5.3:  Step  Response  of  System  Before  Minimization 


83 


TABLE  5.5:  Optimal  Feedback  Gains  Corresponding  to  Figure  5.3 


MINIMIZATION 
PERIOD  (SEC) 

_ 

OPTIMAL 
FEEDBACK  GAINS 

VALUE  OF  COST 
INDEX  AFTER 

10.0  SEC.  SIMULATION 

2.0 

to  =  0.14 
t,  =  5.87 
*2  =  1.14 

Jfc3  =  0.88 

43.60 

4.0 

to  =  1.04 
t,  =  1.31 
t2  =  1.53 
t3  =  0.64 

10.19 

6.0 

to  =  1.05 
t,  =  2.03 
t2  =  0.83 
t3  =  0.71 

6.08 

10.0 

to  =  1.20 
t,  =  2.35 
t2  =  1.29 
t3  =  0.63 

5.72 

_  J 

The  second  problem  encountered  in  the  optimization  was  with  the  contour  of 
the  performance-index  surface.  As  the  control  weighting  was  increased,  the  cost 
surface  became  flatter.  The  flatness  of  the  surface  made  it  difficult  to  find  the 
absolute  or  global  minimum.  For  a  q  value  of  5.0,  Table  5.4  reflects  optimal  feedback 
gains  of  ko  =  1.39,  tj  =  2.81,  k 2  =  1.76,  and  t3  =  0.88.  The  associated  value  of  the 
cost  index  was  5.73.  For  the  same  system  and  control  weighting,  feedback  gains  of 
ko  =  0.67,  fci  =  0.83,  £2  =  0.60,  and  t3  =  0.67  resulted  in  a  cost  of  5.82.  The  two 
sets  of  optimal  feedback  gains  were  relatively  far  apart,  but  gave  nearly  the  same 
value  for  the  cost  index.  This  indicated  a  nearly  flat  cost  surface.  As  the  value  of 
the  control  weighting  was  increased,  the  cost  surface  became  even  flatter. 
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Figure  5.4:  Optimal  Step  Responses  Using  Various  Minimization  Periods 
(F.T.  =  Finishing  Time  of  Minimization) 


The  above  problems  translated  to  the  fact  that  the  index  of  Equation  5.2  could 
not  be  easily  and  reliably  used  for  control  weightings  above  1.0. 

C.  NONLINEAR  PERFORMANCE  OF  THE  LINEAR  OPTIMIZA¬ 
TION 

For  a  linear  control  system,  the  characteristic  response  to  a  step  input  remains 
the  same  regardless  of  the  magnitude  of  the  step.  The  number  of  overshoots  and 
undershoots,  as  well  as  the  settling  time,  remains  constant.  These  characteristics 
can  only  be  changed  by  redesigning  the  system.  For  a  system  with  signal  limita¬ 
tions,  the  time  required  to  carry  out  a  step  command  increases  with  the  size  of  the 
step.  No  prediction  can  be  made  as  to  the  characteristic  nature  of  the  transient 
response.  If  the  objective  is  to  simply  reduce  the  response  time  to  its  minimum 
value,  the  ideal  operating  procedure  is  to  use  a  saturated  drive  at  all  times.  The 
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concept  is  that  maximum  forward  drive  is  applied  at  t  =  0  and  is  reversed  at  a 
proper  instant  t  =  t reverse >  so  that  deceleration  under  maximum  reverse  drive 
reduces  the  velocity  to  zero  at  precisely  the  commanded  value  of  the  output.  [Ref. 
8:p.  433]  This  emphasis  on  total  response  time  neglects  the  amount  of  total  error 
in  the  response  and  places  a  hard  limit  on  the  amount  of  control  input  allowed; 
conversely,  the  cost  functional  of  Equation  5.2  penalizes  the  amount  of  system  error 
and  effectively  places  an  adjustable  soft  limit  on  the  amount  of  control  used.  In  the 
absence  of  any  saturating  elements,  the  amount  of  control  used  is  only  limited  by 
the  usage  penalty  imposed  by  Equation  5.2.  The  optimal  control  value  determined 
by  minimizing  Equation  5.2  may  or  may  not  saturate  any  nonlinear  element  which 
is  later  introduced  to  the  system.  The  question  then  arises  as  to  what  effect  the 
introduction  of  a  saturating  element  has  on  the  optimal  transient  response  of  the 
linear  system.  To  answer  this  question,  the  fourth-order  plant  of  Equation  5.4  was 
employed  with  the  feedback  compensation  scheme  presented  in  Figure  5.1.  The  sys¬ 
tem  was  then  optimized  using  the  cost  index  of  Equation  5.2.  The  control  weighting, 
q,  was  set  at  0.1,  and  a  step  input  of  1.0  was  used  in  the  optimization.  The  optimal 
step  response  is  presented  in  Figure  5.5.  A  saturating  element  was  then  introduced 
into  the  system  as  shown  in  Figure  5.6.  Using  the  linear  optimal  solution,  the  non¬ 
linear  system  was  simulated  for  a  10.0  second  period  using  various  saturation  limits. 
The  results  of  these  simulations  are  presented  in  Table  5.6.  For  saturation  limits 
of  ±5.0  and  above,  no  limiting  effects  were  noted.  The  response  time  remained  at 
approximately  3.5  seconds.  As  the  saturation  limits  were  lowered,  the  duration  of 
the  limiting  increased.  This  increased  limiting  caused  a  corresponding  increase  in 
both  the  response  time  and  the  value  of  the  cost  index.  It  was  noted  that  decreasing 
the  saturation  limits  had  the  same  effect  as  increasing  the  step  size.  The  method  of 
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1.2 


Figure  5.5:  Step  Response  of  Optimal  Linear  System 

decreasing  the  saturation  limits  was  chosen  so  as  to  allow  the  use  of  a  common  scale 
in  the  comparison  of  the  performance  criteria. 

A  graphical  portrayal  of  selected  trials  from  Table  5.6  are  presented  in  Figures 
5.7  and  5.8.  Figure  5.7  shows  the  value  of  control  used  as  a  function  of  time  for 
saturation  limits  of  ±5.0,  ±  1.0,  and  ±  0.5.  At  a  saturation  limit  of  ±  5.0,  no 
limiting  occurred.  When  the  saturation  limits  were  lowered  to  ±1.0  and  ±0.5,  the 
system  was  constrained  by  the  upper  limit  for  progressively  longer  periods.  The 
lower  limits  were  never  reached.  Figure  5.8  shows  the  corresponding  step  responses 
of  the  systems  portrayed  in  Figure  5.7.  As  the  saturation  limits  were  increased, 
the  system  became  slower;  however,  the  general  form  of  the  transient  response  was 
relatively  unchanged.  Although  the  percent  overshoot  was  slightly  reduced,  the  only 
significant  adjustment  was  a  slower  rise  time. 
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Figure  5.6:  Block  Diagram  of  Nonlinear  System 


TABLE  5.6:  Linear  System  Optimization  Employed  with  Nonlinear  Sys¬ 
tem;  Step  Size  =  1.0,  q  =  0.1,  Varying  Saturation  Limits 


SATURATION 

LIMITS 

VALUE  OF 
/[*  |£|  +qU2]dt 

DURATION  OF 
SATURATION  (SEC) 

SETTLING 
TIME  (SEC) 

±  5.0 

1.586 

0.00 

3.5 

±  4.0 

1.575 

0.20 

3.5 

±  3.0 

1.572 

0.35 

3.5 

±2.0 

1.634 

0.50 

3.8 

±  1.0 

2.074 

1.25 

4.2 

±  0.5 

3.240 

2.20 

5.2 
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Figure  5.7:  Control  Input  Response  Curve  for  Saturation  Limits  of 
±5.0,  ±1.0,  and  ±0.5.  Saturation  of  ±5.0  is  Effectively  a  Linear  System 
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Figure  5.8:  Step  Responses  of  Systems  Depicted  in  Figure  5.7 
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C:SflT.  AT  . 5/Cl: SAT.  AT  1.0/CZ: LINEAR  SYSTEM 


As  previously  mentioned,  decreasing  the  saturation  limits  had  the  same  effect 
as  increasing  the  step  input  to  the  system;  however,  decreasing  the  limits  was  the 
most  expedient  way  to  heavily  saturate  the  system.  In  order  to  provide  this  extreme 
saturation,  saturation  limits  were  set  at  ±5.0  and  step  inputs  from  1.0  to  100.0  were 
used.  Table  5.7  shows  the  results  of  the  simulations.  The  general  trends  remained 
the  same  as  those  obtained  by  varying  the  saturation  limits.  As  the  step  input  was 
increased,  the  value  of  the  cost  index  and  the  duration  of  the  saturation  and  settling 
time  were  increased.  The  linear  system  was  optimized  to  a  specific  control  input 

TABLE  5.7:  Linear  System  Optimization  Employed  with  Nonlinear  Sys¬ 
tem;  q  =  0.1,  Saturation  Limit  =  5.0,  Varying  Step  Size  Input 


SIZE  OF 
STEP  INPUT 

VALUE  OF 
f\t\E\+,uHt))dt 

DURATION  OF 
SATURATION  (SEC) 

SETTLING 
TIME  (SEC) 

1.0 

1.586 

0.00 

3.5 

1.5 

2.675 

0.20 

5.0 

2.0 

3.784 

0.40 

5.2 

5.0 

13.362 

1.20 

5.8 

10.0 

38.490 

2.00 

6.2 

50.0 

847.460 

8.81 

11.8 

100.0 

4342.500 

14.82 

16.5 

based  on  a  control  cost  of  0.1  multiplied  by  the  square  of  the  control  input.  The 
optimal  feedback  gains  reflected  the  best  compromise  between  this  value  and  the 
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value  of  time  multiplied  by  the  absolute  value  of  the  error.  When  the  limiter  was 
added  to  the  system,  the  amount  of  control  used  was  reduced  during  the  period  of 
saturation.  The  compromise  was  no  longer  valid.  As  the  step  input  was  increased, 
the  system  remained  in  saturation  for  longer  periods  of  time.  Longer  saturation 
periods  resulted  in  larger  deviations  from  the  compromise  and,  correspondingly, 
higher  values  for  the  cost  index.  During  these  saturation  periods,  the  system  was 
operating  in  an  open  loop  mode,  at  full  capacity,  trying  to  correct  the  system  error. 

The  control  and  output  responses  are  depicted  for  selected  step  inputs  in 
Figures  5.9  and  5.10,  respectively.  The  general  shape  of  the  transient  response 
remained  unchanged,  while  the  rise  time  became  slower  with  increasing  step  size. 
It  was  of  interest  to  note  that  even  in  the  heavily  saturated  case  of  a  step  input 
equal  to  100.0,  the  transient  response  maintained  its  characteristic  one-overshoot, 
no- undershoot  response. 
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Figure  5.9:  Control  Input  Response  for  Step  Inputs  of  5.0,  2.0,  and  1.0 
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Figure  5.10:  Step  Responses  for  Step  Inputs  of  5.0,  2.0,  and  1.0 
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D.  COMPARISON  OF  COST  INDEXES 


In  his  work  with  the  linear  quadratic  regulator  of  Equation  5.1,  Sheldon  S. 
L.  Chang  [Ref.  9]  suggested  that  a  linear  system  which  had  been  optimized  using 
this  cost  index  was  superior  to  one  which  had  not.  Chang  asserted  that  when  a 
saturating  element  was  placed  in  the  circuit,  the  system  which  was  optimized  using 
the  cost  function  of  the  linear  quadratic  regulator  showed  a  far  superior  transient 
response  over  a  system  which  was  not  optimized  using  this  cost  index.  The  theory 
behind  his  allegation  centered  around  the  presence  of  the  control  cost  within  the 
performance  index.  He  implied  that  the  presence  of  this  control  cost  reduced  the 
magnitude  of  the  control  signal;  consequently,  the  amount  of  saturation  experienced 
by  the  system  was  reduced.  Because  of  the  reduced  saturation,  he  forecast  a  much 
better  transient  response  in  terms  of  overshoot,  undershoot,  and  settling  time.  (Ref. 
9:pp.  11-30] 

From  Chang’s  work,  a  logical  extension  of  theory  was  that  the  cost  function 
of  Equation  5.2  would  exhibit  the  same  traits  as  that  of  the  linear  quadratic  regu¬ 
lator.  Specifically,  a  linear  system  which  was  optimized  using  Equation  5.2  would 
perform  better  in  the  presence  of  a  limiter  than  a  system  which  wa s  designed  with 
no  constraint  on  the  amount  of  control  used.  The  purpose  of  this  section  was  to 
investigate  this  conjecture. 

Using  a  control  weighting  of  0.1  in  Table  5.4,  it  was  found  that  the  minimiza¬ 
tion  of  the  cost  index  of  Equation  5.2  resulted  in  optimal  feedback  gains  of  kc,  = 
5.37,  =  6.59,  k 2  =  2.38,  and  k 3  =  0.36.  Following  the  same  procedure  as  was 

outlined  in  Chapter  III,  the  fourth-order  system  was  optimized  using  the  integral 
of  time  multiplied  by  the  absolute  value  of  error.  With  the  zero-derivative  feedback 
gain  set  at  5.37,  the  optimal  feedback  gains  were  determined  to  be  k 1  =  4.90,  k 2  = 
0.97,  and  k3  =  -0.244.  This  exercise  provided  two  systems  of  the  same  bandwidth; 


95 


however,  each  system  was  designed  by  minimizing  a  different  cost  index.  The  per¬ 
formance  index  of  the  first  system  included  a  control  cost  with  a  weighting  of  q  = 
0.1,  while  the  performance  index  of  the  second  system  provided  no  limit  on  the  use 
of  control  input.  Both  optimizations  were  then  simulated  in  the  nonlinear  system  of 
Figure  5.6.  The  saturation  limits  of  the  limiter  were  varied  and  the  value  of  the  cost 
index  of  Equation  5.2  evaluated.  The  results  of  these  simulations  are  presented  in 
Table  5.8.  System  1  refers  to  the  minimization  of  the  integral  of  time  multiplied  by 
the  absolute  value  of  the  error,  and  system  2  refers  to  the  minimization  of  Equation 
5.2  with  q  =  0.1.  Since  system  2  was  optimized  with  a  constraint  on  the  amount  of 
control  used,  lower  absolute  saturation  limits  were  needed  before  any  limiting  effects 
were  seen.  In  this  case,  limiting  effects  were  noted  at  the  limits  of  ±3.00.  System 
1  reached  saturation  with  limits  of  ±  6.00.  From  the  saturation  limits  of  ±  6.00  to 
±  1.00,  the  value  of  the  cost  index  for  system  1  exceeded  the  value  of  system  2.  At 
the  limit  ±  1.00,  the  value  of  the  cost  indexes  for  the  two  systems  became  equal. 
System  1  had  a  saturation  period  of  2.6  seconds,  which  was  more  than  double  that  of 
system  2.  This  did  not  imply  that  the  control  input  of  the  two  systems  were  equal; 
however,  it  did  imply  that  the  value  obtained  by  adding  the  total  system  error  to 
the  control  input  was  equal  for  the  two  systems.  For  absolute  limiting  values  of  less 
than  ±  1.0,  the  value  of  the  cost  index  for  system  1,  again,  exceeded  the  value  of 
system  2. 

In  Figures  5.11  and  5.12  are  presented  the  control  input  and  the  step  responses 
for  the  two  systems  at  saturation  limits  of  ±5.0  and  ±1.0.  Figure  5.11  shows  that 
at  a  saturation  limit  of  ±5.0,  system  1  was  in  saturation  and  system  2  was  not. 
At  the  saturation  limit  of  ±1.0,  system  2  was  saturated  by  the  upper  limit  while 
system  1  was  saturated  by  both  the  upper  and  lower  limit.  Figure  5.12  shows 
the  corresponding  step  responses  for  these  systems.  Even  in  the  presence  of  heavy 
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TABLE  5.8:  Simulation  Results  for  Systems  Optimized  Using  Different 
Cost  Indices.  System  1:  Optimized  Using  /  [f  |e(f)|]  dt,  System  2:  Opti¬ 
mized  Using  f[t  |e(f)|  +0.1u2(<)]  dt,  Step  Input  =  1.0,  Simulation  Period  = 
8.0  seconds. 


SATURATION 

LIMITS 

SATURATION  PERIOD  (SEC) 

VALUE  OF 

!\t  KOI  +0.M0M* 

SYSTEM  1 

SYSTEM  2 

SYSTEM  1 

SYSTEM  2 

±  6.00 

0.2 

0.0 

2.38 

1.59 

±  5.00 

0.4 

0.0 

2.21 

1.59 

±  3.00 

0.7 

0.3 

1.79 

1.57 

±  1.00 

2.6 

1.2 

2.07 

2.07 

±  0.50 

3.9 

1.8 

3.43 

3.24 

±  0.25 

5.8 

4.6 

6.35 

5.93 

saturation,  system  1  remained  faster;  however,  it  experienced  more  overshoot  of  the 
steady-state  position.  In  terms  of  which  system  responded  best  in  the  presence  of 
a  limiter,  system  2  had  a  very  slight  advantage.  When  the  limit  was  moved  from 
no  saturation  at  limits  of  ±5.0  to  heavy  saturation  at  limits  of  ±1.0,  the  transient 
response  of  system  2  maintained  its  basic  shape.  The  major  change  was  a  slower  rise 
time  accompanied  by  a  slightly  lower  percent  overshoot.  System  1  also  decreased 
its  rise  time,  but  increased  its  percent  overshoot  as  well.  System  1  maintained  its 
faster  response  to  the  first  steady-state  crossing  throughout  the  range  of  limiting 
values.  The  question  of  which  was  the  better  response  remained  a  question  of  the 
use  for  which  the  system  was  to  be  used;  however,  the  results  did  not  indicate  a 
large  advantage  for  including  a  control  cost  in  the  performance  index.  When  placed 
in  heavy  saturation,  neither  system  exhibited  any  type  of  rapid  deterioration  of  the 


97 


response.  Inclusion  of  the  control  cost  in  the  performance  index  of  the  linear  system 
did  provide  a  slightly  more  favorable  and  predictable  response  when  subjected  to 
a  limiter;  specifically,  the  response  stayed,  essentially,  the  same  with  a  predictable 
decrease  in  rise  time. 
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Figure  5.11:  Control  Input  Response 
U:  System  2  with  Limiter  at  ±5.0 
Ul:  System  1  with  Limiter  at  ±5.0 
U8:  System  2  with  Limiter  at  ±1.0 
Ul9:  System  1  with  Limiter  at  ±1.0 
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Figure  5.12:  Step  Response 
C:  System  2  with  Limiter  at  ±5.0 
Cl:  System  1  with  Limiter  at  ±5.0 
C8:  System  2  with  Limiter  at  ±1.0 
C19:  System  1  with  Limiter  at  ±1.0 
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E.  THE  LINEAR  QUADRATIC  REGULATOR 


Based  on  the  results  of  the  previous  section,  it  was  of  interest  to  further  investi¬ 
gate  Chang’s  work  with  the  linear  quadratic  regulator.  Chang  based  his  conclusions 
on  the  results  of  a  single  example.  It  was  the  purpose  of  this  section  to  repeat  this 
example  to  determine  if  the  results  could  be  duplicated.  Chang’s  design  process  was 
not  questioned,  only  the  performance  of  and  the  conclusions  drawn  from  the  final 
design. 

A  hydraulic  system  for  position  control  was  designed  with  the  specifications  of 
15.0  percent  overshoot  or  less,  and  a  response  time  of  approximately  0.01  seconds. 
The  transfer  function  of  the  hydraulic  valve  and  servomotor  system  is  given  in 
Equation  5.5, 


G,(S)  = 


K 


l.o +  0.4  (£)  +  (£)■ 


(5.5) 


where  Ar=200.0  radians/ second  and  lj  =  157.0  radians/second.  Chang  proposed 
two  cascade  compensation  schemes.  The  first  of  these  was  designed  by  conventional 
root-locus  techniques  with  no  regard  to  the  amount  of  control  input  used.  The 
second  design  was  based  on  a  root-square-locus  plot  which  attempted  to  minimize 
the  amount  of  control  used  in  accordance  with  the  linear  quadratic  regulator.  Equal 
weighting  was  given  to  the  total  system  error  and  the  amount  of  control  used. 
The  transfer  functions  of  the  conventional  and  root-square-locus  compensation  are 
presented  in  Equations  5.6  and  5.7,  respectively. 


Gei(S) 


1.04 

1.0 +  0.4 

'(S  +  I 

(5f 

1 

[l.O +  0.6151 

m 

[1.0  +  0.069 

(5)1 

(5.6) 


G«(S)  = 


0.859 

1.0 +  0.4  | 

(5) 

i  +  ( 

5)1 

1.0  +  0.4531 

(5) +0.H0 

(5)’ 

(5.7) 
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The  system  utilizing  the  compensation  of  Equation  5.7  was  called  the  optimum 
system,  and  the  system  employing  the  compensation  scheme  of  Equation  5.6  was 
called  the  conventional  system.  Note  that  both  compensation  schemes  employed 
the  compensator  zeros  to  cancel  the  plant’s  poles,  and  replaced  these  poles  with 
the  poles  of  the  compensator.  [Ref.  10:pp.  81-87]  To  determine  the  performance  of 
these  systems  in  the  presence  of  a  limiter,  the  compensation  schemes  were  simulated 
in  the  system  of  Figure  5.13  with  step  inputs  of  1.0.  Setting  saturation  limits  of 
±10.0,  the  responses  of  Figures  5.14  and  5.15  were  obtained.  Figure  5.14  gives 
the  responses  of  signals  X(S)  and  U(S ),  and  shows  that  neither  system  was  in 
saturation.  The  corresponding  output  responses  are  shown  in  Figure  5.15.  Both 
systems  were  operating  in  the  linear  region  and  had  nearly  identical  step  responses. 


Figure  5.13:  Block  Diagram  of  Nonlinear  System  Used  in  Chang’s  Ex¬ 
ample 
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Figure  5.14:  Signals  X(S)  and  U(S)  Corresponding  to  Figure  5.13, 

Limits  =  ±10.0. 

L:  Optimal  U(S)  Signal 
LA:  Conventional  U(S)  Signal 
X :  Optimal  X(S)  Signal 
XA:  Conventional  X(S)  Signal 
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Figure  5.15:  Step  Responses  of  Optimal  and  Conventional  Systems, 

Limits  =  10.0 

OUT:  Output  of  Optimal  System 
OUTA:  Output  of  Conventional  System 
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Noting  that  the  input  to  the  limiter  reached  a  maximum  of  approximately  0.75 
for  both  systems,  the  saturation  point  wa s  successively  moved  to  lower  saturation 
values  to  find  the  point  of  greatest  divergence  between  the  two  step  responses.  Satu¬ 
ration  limits  of  ±0.4  were  found  to  provide  the  largest  variance  between  the  optimal 
and  conventional  systems.  The  graphical  results  of  this  simulation  is  provided  in 
Figures  5.16  and  5.17.  Figure  5.16  shows  that  the  conventional  system  remained 
in  saturation  slightly  longer  than  the  optimal  system,  resulting  in  the  differing  step 
responses  of  Figure  5.17.  Although  the  conventional  system  had  larger  overshoots 
and  undershoots  than  the  optimal  system,  these  oscillations  quickly  damped-out  to 
a  settling  time  of  0.15  seconds  for  both  systems.  The  rapid  deterioration  of  the 
conventional  system,  alluded  to  by  Chang,  was  never  obtained. 
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Figure  5.16:  Signals  X(S)  and  U(S)  Corresponding  to  Figure 

Limits  =  0.4 
L:  Optimal  U(S)  Signal 
LA:  Conventional  U(S )  Signal 
X :  Optimal  X(£)  Signal 
XA:  Conventional  A(S)  Signal 
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Figure  5.17:  Step  Responses  of  Optimal  and  Conventional  Systems, 

Limits  =  ±0.4 

OUT:  Output  of  Optimal  System 
OUTA:  Output  of  Conventional  System 
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Chang  argued  that  since  the  conventional  system’s  input  to  the  limiter  was 
larger  than  that  of  the  optimal  system,  the  conventional  system  would  saturate 
more  heavily  and  result  in  a  much  poorer  response.  In  light  of  the  results  of  this 
investigation,  as  well  as  those  of  the  previous  section,  it  could  only  be  concluded 
that  the  presence  of  a  control  cost  in  the  performance  index  did  little  to  enhance 
the  performance  of  a  nonlinear  system. 

F.  LINEAR  PERFORMANCE  OF  A  NONLINEAR  OPTIMIZATION 

Thus  far,  the  study  dealt  with  the  effects  of  inserting  a  saturating  nonlinear¬ 
ity  into  an  optimal  linear  system.  It  was  the  purpose  of  this  section  to  optimize 
the  nonlinear  system  and  evaluate  its  performance  after  the  nonlinearity  had  been 
removed. 

To  investigate  this  possibility,  the  nonlinear  system  of  Figure  5.6  was  optimized 
using  the  cost  index  of  Equation  5.2.  Various  values  of  the  control  weighting  were 
used.  It  is  important  to  note  that  before  optimizing  the  nonlinear  system,  it  was 
necessary  to  ensure  that  the  saturation  limits  were  small  enough  to  allow  operation  in 
the  nonlinear  region.  If  the  limits  were  too  large,  the  optimization  would  have  been, 
in  essence,  a  linear  optimization.  For  the  system  of  Figure  5.6,  saturation  limits  of 
±3.0  and  ±1.0  were  used.  The  results  of  the  nonlinear  optimization  are  presented  in 
Table  5.9.  If  Table  5.9  is  compared  to  the  linear  optimization  of  Table  5.4,  the  effect 
of  the  nonlinearity  can  be  seen.  At  saturation  limits  of  ±3.0,  the  nonlinear  system 
was  in  saturation  for  only  a  short  time  with  the  remainder  of  the  transient  period 
operating  in  the  linear  region;  consequently,  there  was  little  difference  between  the 
nonlinear  optimal  parameters  and  the  linear  optimal  parameters.  At  the  saturation 
limits  of  ±1.0,  the  nonlinear  system  remained  saturated  for  approximately  one-half 
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of  the  transient  period;  consequently,  substantially  different  optimal  feedback  gains 
were  obtained. 

Removing  the  nonlinearity  from  the  system  of  Figure  5.6  and  employing  the 
nonlinear  optimal  gains  of  Table  5.9,  the  step  responses  of  Figure  5.18  were  obtained. 
They  represent  nonlinear  optimal  parameters  employed  in  a  linear  system.  As  the 
value  of  the  control  weighting  was  increased,  the  optimal  parameters  resulted  in 
slower  system  responses.  The  reason  for  this  trend  could  be  seen  by  examining  the 
nonlinear  optimization  process.  During  optimization,  the  system  operated  in  either 
the  saturated  or  linear  region.  When  the  system  was  in  saturation,  the  amount  of 
control  was  set  by  the  limiter.  When  the  system  was  operating  in  the  linear  region, 
the  amount  of  control  was  determined  by  the  value  of  the  control  weighting.  As 
the  control  weighting  was  increased,  the  amount  of  control  used  during  the  linear 
operation  decreased;  consequently,  less  control  input  resulted  in  slower  systems. 
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TABLE  5.9:  Optimizing  the  Nonlinear  System  Using  /  [f  |e(t)|  +ou2(01  dt. 
Step  Input  =  1.0,  Integration  Time  =  10.0  sec. 


fVALUEOF 

1  LIMITS 

VALUE  OF' 

OF, 

VALUE  OF 

COST  INDEX 

OPTIMAL  FEEDBACK 

GAINS 

±3.0 

0.1 

1382 

fco  =  5.417 
*1  a  6385 
k2  *  2343 
*3  a  0319 

±3.0 

0.5 

2396 

k<>  a  2.485 
ki  a  3311 
*2  a  1322 
k2  s  0.255 

±3.0 

1.0 

3320 

*0  a  2.476 
*1  a  4j069 
kj  a  1965 
*3  »  0395 

±3.0 

5j0 

5.979 

*o  =  3.111 
*1  a  4.681 
ki  =  3.661 
k,  a  13M 

±3.0 

10.0 

7341 

ko  a  1.431 
ki  a  3381 
ki  a  2.831 
*j  a  1.781 

±3.0 

100.0 

20.246 

*0  a  0382 
*1  a  0988 
*2  a  1.205 
ki  =  1303 

j±1.0 

0.1 

1968 

*0  a  7356 
ki  a  7320 
ki  =  1918 
ki  a  -0.029 

±1.0 

0.5 

2.655 

ko  a  4387 
*1  a  6444 
*2  a  2324 
*3  a  0343 

±1.0 

1  4 

3.278 

to  a  4.521 
*1  a  4.521 

k2  a  2.606 

k3  a  0389 

±1.0 

54 

5313 

*0  a  3.477 
ki  a  7342 
*2  =  6.146 
*3  a  2364 

±1.0 

10.0 

7345 

*0  a  1.100 
ki  a  2.412 
*2  a  1394 
*3  a  0992 

±1.0 

100.0 

21.792 

*0  =  0.732 
ki  a  2314 
*2  =  5386 
ki  -  1413 
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Figure  5.18:  Step  Responses  of  Nonlinear  Optimal  Gains  (Limits  = 
±1.0)  When  Employed  in  a  Linear  System 
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G.  COMPARISON  OF  NONLINEAR  AND  LINEAR  OPTIMAL  SYS¬ 
TEMS 

In  order  to  better  determine  the  differing  effects  between  the  optimization  of  a 
linear  system  and  a  nonlinear  system,  a  battery  of  simulations  was  conducted  using 
the  feedback  gains  presented  in  Tables  5.4  and  5.9.  The  values  of  Table  5.4  reflect 
the  results  of  the  fourth-order  linear  optimization,  and  Table  5.9  reflects  the  results 
of  the  fourth-order  nonlinear  optimization.  For  each  control  weighting,  the  optimal 
linear  and  nonlinear  gains  were  simulated  in  both  a  nonlinear  and  linear  system.  The 
results  of  the  nonlinear  system  simulations  are  presented  in  Figures  5.19  through 
5.24.  Referring  to  Figures  5.19  and  5.20,  which  reflect  a  control  weighting  of  0.1, 
the  nonlinear  optimization  remained  in  saturation  much  longer  than  that  of  the 
linear  optimization.  The  heavy  saturation  of  the  nonlinear  optimization  resulted  in 
a  faster  and  less  costly  step  response.  The  nonlinear  gains  had  a  performance  index 
value  of  1.968,  while  the  linear  gains  resulted  in  a  value  of  2.073.  The  nonlinear 
gains  utilized  the  system  to  its  full  capacity  for  nearly  the  entire  transient  period. 

As  the  control  weighting  wa s  increased  to  higher  values,  the  superiority  of 
the  nonlinear  gains  decreased.  For  a  control  weighting  of  1.0,  the  value  of  the 
performance  indices  were  nearly  equal  for  the  two  systems.  The  nonlinear  gains 
resulted  in  a  cost  of  3.278,  and  the  linear  gains  gave  a  cost  of  3.261.  As  shown 
in  Figure  5.21,  both  systems  saturated  only  at  the  upper  limit  with  the  nonlinear 
system  remaining  in  saturation  for  a  longer  period  of  time.  As  shown  in  Figure  5.22, 
the  nonlinear  gains  resulted  in  a  faster  rise  time  for  the  step  response. 

The  difference  between  the  nonlinear  and  linear  responses  continued  to  de¬ 
crease  as  the  control  weighting  was  increased  to  5.0.  Figures  5.23  and  5.24  show 
that  neither  system  remained  in  saturation  for  long  periods  of  time,  and  the  step 
responses  were  nearly  identical. 
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The  above  results  reinforce  the  knowledge  that  the  most  efficient  system  is  one 
that  utilizes  its  components  to  their  full  capacity.  If  the  control  weighting  is  small 
enough  to  allow  the  system  to  saturate,  a  more  optimal  system  is  attained  through 
the  optimization  of  the  nonlinear  system.  In  the  system  under  study,  control  weight¬ 
ings  of  below  1.0  were  required.  In  other  performance  indices,  such  as  the  linear 
quadratic  regulator,  the  range  of  control  weightings  which  cause  saturation  will  ex¬ 
pand.  This  means  that  nonlinear  optimization  remains  superior  for  higher  values 
of  the  control  weighting.  As  the  control  weightings  are  increased  to  values  which 
do  not  allow  long  saturation  periods,  linear  and  nonlinear  optimal  gains  perform 
equally  as  well. 
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Figure  5.19:  Linear  Versus  Nonlinear  Optimal  Gains  in  a  Nonlinear 

System,  <7=0.1 

U:  Control  Signal  for  Linear  Gains 
U 1:  Control  Signal  for  Nonlinear  Gains 
COST:  Value  of  Cost  Index  for  Linear  Gains 
COSTl:  Value  of  Cost  Index  for  Nonlinear  Gains 
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Figure  5.20:  Linear  Versus  Nonlinear  Optimal  Gains  in  a  Nonlinear 

System,  g=0.1 

C :  Control  Signal  for  Linear  Gains 
Cl:  Control  Signal  for  Nonlinear  Gains 


115 


Tire 


T\ 


Z 

«b 

o 

0.6- 

1 

- 4 - 

o 

Z — 

o 

— ° - 

o 

rvj  V 

o  o 

in 

E- 

~jr~ 

T"'" 

— S“ 

— JT“ 

iA  c) 

• 

V 

m 

n 

o  o 

— -thb 

. us'dj 

Figure  5.21;  Linear  Versus  Nonlinear  Optimal  Gains  in  a  Nonlinear 

System,  <7=1.0 

U'.  Control  Signal  for  Linear  Gains 
U 1:  Control  Signal  for  Nonlinear  Gains 
COST:  Value  of  Cost  Index  for  Linear  Gains 
COSTl:  Value  of  Cost  Index  for  Nonlinear  Gains 
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Figure  5.22:  Linear  Versus  Nonlinear  Optimal  Gains  in  a  Nonlinear 

System,  <7=1.0 

C:  Control  Signal  for  Linear  Gains 
Cl:  Control  Signal  for  Nonlinear  Gains 
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Figure  5.23:  Linear  Versus  Nonlinear  Optimal  Gains  in  a  Nonlinear 

System,  <7=5.0 

U:  Control  Signal  for  Linear  Gains 
U 1:  Control  Signal  for  Nonlinear  Gains 
COST:  Value  of  Cost  Index  for  Linear  Gains 
COSTl:  Value  of  Cost  Index  for  Nonlinear  Gains 
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Figure  5.24:  Linear  Versus  Nonlinear  Optimal  Gains  in  a  Nonlinear 

System,  <7=5.0 

C:  Control  Signal  for  Linear  Gains 
Cl:  Control  Signal  for  Nonlinear  Gains 
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Following  the  above  studies,  the  linear  and  nonlinear  optimal  gains  were  sim¬ 
ulated  in  a  linear  system.  The  graphical  results  of  these  simulations  are  presented 
in  Figures  5.25  through  5.27.  For  all  values  of  the  control  weighting,  the  nonlinear 
gains  resulted  in  a  faster  response  and  a  higher  value  of  the  performance  index. 

For  a  cost  weighting  of  0.1,  the  graphs  of  Figures  5.25  and  5.26  show  that  the 
control  signal  of  the  nonlinear  system  held  more  overshoot  and  undershoot  than  that 
of  the  linear  system.  During  the  optimization  of  the  nonlinear  system,  the  mini¬ 
mization  of  the  cost  function  attempted  to  keep  the  system  in  constant  saturation. 
The  value  of  the  cost  index  was  reduced  by  operating  the  system  near  saturation. 
The  value  of  time  multiplied  by  the  absolute  value  of  the  error  was  reduced  by 
increasing  the  rise  time  and  decreasing  the  overshoot.  In  the  linear  optimization, 
the  optimal  cost  reduction  was  attained  by  reducing  the  control  signal.  The  smaller 
control  signal  resulted  in  a  slower  rise  time  and  more  overshoot.  The  minimization 
of  the  cost  index  was  a  trade-off  between  the  amount  of  control  and  the  integral  of 
time  multiplied  by  the  absolute  value  of  error.  In  the  nonlinear  optimization,  the 
greatest  reduction  in  the  index  came  from  a  reduction  of  time  multiplied  by  the 
absolute  value  of  error.  In  the  linear  system  optimization,  the  greatest  reduction 
came  from  a  reduction  of  the  control  signal.  When  the  results  of  both  systems  were 
placed  in  a  linear  system,  the  optimal  nonlinear  gains  resulted  in  a  faster  system 
with  less  overshoot.  The  nonlinear  gains  were  not  optimal  for  the  linear  system  and 
resulted  in  a  higher  value  of  the  cost  index.  The  value  of  the  cost  index  for  the 
linear  system  was  1.58,  while  that  of  the  nonlinear  system  was  2.25. 

As  the  value  of  the  control  weighting  was  increased  to  5.0,  the  nonlinear  and 
linear  gains  gave  an  almost  identical  response.  This  control  weighting  precluded  the 
nonlinear  optimization  from  operating  in  constant  saturation  and  bounded  it  to  the 
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linear  region  for  the  majority  of  the  transient  period.  As  shown  in  Figures  5.27  and 
5.28,  the  characteristics  of  the  two  systems  became  nearly  identical. 
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Figure  5.25:  Linear  Versus  Nonlinear  Optimal  Gains  in  a  Linear 

System,  <7=0.1 

U :  Control  Signal  for  Linear  Gains 
U 1:  Control  Signal  for  Nonlinear  Gains 
COST:  Value  of  Cost  Index  for  Linear  Gains 
COSTl:  Value  of  Cost  Index  for  Nonlinear  Gains 
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Figure  5.26:  Linear  Versus  Nonlinear  Optimal  Gains  in  a  Linear 

System,  <7=0. 1 

C:  Control  Signal  for  Linear  Gains 
Cl:  Control  Signal  for  Nonlinear  Gains 
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Figure  5.27:  Linear  Versus  Nonlinear  Optimal  Gains  in  a  Linear 

System,  q=5.0 

U:  Control  Signal  for  Linear  Gains 
U 1:  Control  Signal  for  Nonlinear  Gains 
COST:  Value  of  Cost  Index  for  Linear  Gains 
COST1:  Value  of  Cost  Index  for  Nonlinear  Gains 
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Figure  5.28:  Linear  Versus  Nonlinear  Optimal  Gains  in  a  Linear 

System,  <7=5.0 

C :  Control  Signal  for  Linear  Gains 
Cl:  Control  Signal  for  Nonlinear  Gains 
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VI.  SUMMARY  AND  CONCLUSIONS 


This  study  dealt  solely  with  all-pole  plants  with  one  pole  located  at  the  ori¬ 
gin.  This  implied  zero  steady-state  error.  All  optimizations  were  conducted  using 
full-state-feedback  compensation  in  the  minor  loop.  Based  on  the  preliminary  work 
done  by  Graham  and  Lathrop,  the  integral  of  time  multiplied  by  the  absolute  value 
of  error  was  accepted  as  the  best  performance  criterion  due  to  its  reliability,  ease 
of  application  and  selectivity;  however,  it  was  emphasized  that  this  criterion  repre¬ 
sented  a  compromise  between  the  conflicting  characteristics  of  the  percent  overshoot 
of  the  steady-state  position  and  the  time  required  to  reach  the  first  zero-error  sig¬ 
nal.  The  cost  function  was  unrealistic  in  its  assumption  of  the  availability  of  infinite 
control  signal.  To  correct  this  inadequacy,  an  alternative  performance  index  was 
introduced  which  penalized  the  use  of  control.  It  was  found  that  the  cost  function 
was  a  mathematical  tool  used  to  artificially  define  an  optimal  system.  Its  use  may 
or  may  not  have  resulted  in  a  system  which  met  the  specifications  needed  in  the 
design.  It  was  concluded  that  it  may  be  possible  for  an  experienced  designer  to  ap¬ 
ply  the  appropriate  weightings  within  the  index  to  reflect  his  needs,  but  no  precise 
relationships  between  specifications  and  weightings  were  established. 

In  the  utilization  of  the  integral  of  time  multiplied  by  the  absolute  value  of 
the  error,  it  was  concluded  that  systems  utilizing  full-state-feedback  compensation 
could  not  be  optimized.  The  zero-order  derivative  feedback  acted  as  a  variable  gain 
for  the  system,  resulting  in  unrealistic  bandwidths.  The  system  attempted  to  du¬ 
plicate  an  ideal  step  function.  Fixing  the  zero-order  derivative  to  a  constant  value 
fixed  the  bandwidth  of  the  system  and  allowed  the  performance  index  to  reach  a 
true  minimum.  It  was  concluded  that  there  was  only  one  optimal  solution  for  a 
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given  iV^-order  system;  therefore,  there  was  only  one  optimal  root  pattern.  Since 
the  use  of  full-state  feedback  allowed  the  placement  of  the  roots  at  any  location, 
the  roots  remained  at  their  optimal  positions  regardless  of  the  parameters  of  the 
plant.  Any  change  in  the  plant’s  parameters  was  offset  by  a  corresponding  increase 
or  decrease  in  the  feedback  gains,  returning  the  roots  to  their  optimal  locations.  In 
the  presence  of  a  saturating  element  at  the  plant  input,  the  system’s  damping  was 
reduced;  however,  the  general  characteristics  of  the  linear  system  were  maintained. 
The  system  maintained  its  characteristic  one-overshoot,  one-undershoot  response. 
When  the  system  was  optimized  in  the  presence  of  the  nonlinearity,  a  more  optimal 
response  was  obtained.  The  presence  of  the  saturating  element  limited  the  speed  of 
the  system  and  resulted  in  a  reduction  of  the  performance  index  based,  mainly,  on 
eliminating  the  error;  whereas,  the  linear  optimization  realized  most  of  its  reduction 
by  increasing  the  speed  of  the  system.  When  the  saturating  element  was  moved  to 
the  system  input,  opposite  effects  were  found.  Employing  the  linear  optimal  gains, 
this  configuration  provided  more  damping.  When  optimized  with  the  nonlinearity 
at  the  new  location,  the  damping  was  reduced  and  the  response  became  more  oscil¬ 
latory.  It  was  concluded  that  the  two  different  positions  of  the  nonlinearity  provided 
a  direct  contrast  in  terms  of  its  effect  on  the  response  of  the  system.  These  results 
held  true  for  any-order,  all-pole  system  utilizing  full-state-feedback  compensation. 
Given  a  saturation  nonlinearity  at  either  the  system  or  plant  input,  it  was  postu¬ 
lated  that  a  designer  could  use  these  general  trends  to  intelligently  determine  the 
compensation. 

The  standard  forms  derived  by  Graham  and  Lathrop  were  studied  to  determine 
their  validity.  It  was  concluded  that  although  their  results  were  impressive,  Graham 
and  Lathrop  failed  to  find  the  absolute  or  global  minimum.  New  standard  forms  were 
derived  which  showed  a  definitive  and  progressive  root  pattern.  The  superiority  and 


127 


usefulness  of  these  standard  forms  were  shown  through  the  use  of  examples  which 
utilized  active  networks  in  their  compensation  schemes. 

A  control  cost  was  added  to  the  criterion  in  the  form  of  the  squared  value 
of  the  input  control  signal.  A  weighting  factor  was  included  which  reflected  the 
relative  importance  of  the  control  signal.  Optimizations  were  conducted  for  third 
and  fourth-order  systems  utilizing  fixed  and  variable-forward-gain  scenarios.  In  the 
fixed  gain  cases,  it  was  concluded  that  increases  in  the  weighting  of  the  control  cost 
caused  optimal  gains  to  increase  and  the  complex  roots  to  retract  to  the  real  axis. 
Due  to  the  mathematical  structure  of  the  index,  the  system  was  highly  sensitive 
to  the  value  of  the  control  weighting.  In  the  variable-gain  cases,  the  complex  roots 
optimized  to  more  random  patterns.  Increases  in  the  control  weighting  translated  to 
less  power  being  supplied  to  the  plant  and  a  slower  system  with  smaller  bandwidths. 
No  definitive  root  pattern  was  established.  Two  problems  were  uncovered  which 
made  the  minimization  of  the  index  difficult.  The  flatness  of  the  cost-index  contour 
and  a  high  dependence  on  the  integration  period  negated  any  assurance  of  finding 
the  absolute  or  global  minimum. 

Using  the  linear  optimal  gains,  a  saturating  nonlinearity  was  inserted  into  the 
system.  Simulations  were  conducted  using  various  step  and  limit  sizes.  It  was  found 
that  the  presence  of  the  limiter  destroyed  the  compromise  between  speed  and  error 
that  had  been  established  in  the  optimization  of  the  linear  system.  As  the  step  sizes 
were  increased  so  as  to  cause  saturation,  the  system  responded  with  an  increase  in 
both  the  response  time  and  the  value  of  the  cost  index.  It  was  concluded  that  the 
general  form  of  the  transient  response  remained  unchanged,  i.e.,  there  was  no  rapid 
deterioration  of  the  response. 

A  comparison  of  the  two  cost  indices  was  conducted  in  terms  of  their  perfor¬ 
mance  in  the  presence  of  a  saturating  nonlinearity.  Specifically,  the  theory  that  a 
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linear  system  which  was  optimized  with  a  performance  index  that  included  a  cost 
constraint  performed  better  in  the  presence  of  saturation  was  investigated.  It  was 
found  that  although  the  inclusion  of  a  control  cost  resulted  in  a  small  reduction  of 
overshoot,  there  was  no  overriding  advantages  for  using  one  index  over  the  other. 
Based  on  this  result,  Sheldon  S.  L.  Chang’s  work  with  the  linear  quadratic  regu¬ 
lator  was  investigated.  Chang’s  results  supporting  the  superiority  of  the  regulator 
were  not  duplicated.  The  conclusion  was  that  the  addition  of  a  control  cost  to  the 
performance  index  did  little  to  enhance  nonlinear  performance. 

In  order  to  thoroughly  investigate  the  cost  functions  under  study,  the  effects 
of  a  nonlinear  optimization  when  employed  in  a  linear  system  were  investigated.  It 
was  found  that  as  the  value  of  the  control  weighting  was  increased,  the  response 
of  the  linear  system  became  slower.  The  explanation  of  this  trend  was  found  by 
examining  the  nonlinear  optimization  process.  During  the  saturation  periods,  the 
amount  of  control  was  set  by  the  limiter.  During  linear  operation,  the  amount 
of  control  was  determined  by  the  value  of  the  control  weighting.  As  the  control 
weighting  was  increased,  the  amount  of  control  used  during  the  linear  operation 
decreased;  consequently,  less  control  input  resulted  in  a  slower  system  response. 
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APPENDIX  A 

Computer  Code  for  the  Optimization  of  the 
Fourth- Order  System  using  the  ITAE  Criterion 


*  EXAMPLE  of  a  typical  minimization  routine  for 

4  THE  INTEGRAL  O"  TIME  MULTIPLIED  BY  THE  ABSOLUTE 
4  VALUE  OF  THE  ERROR  PLUS  A  WEIGHTING  FACTOR 
4  MULTIPLIED  BY  THE  SQUARE  OF  THE  CONTROL  INPUT 
44444444444444444444444444444444444  444444444444444444 

*  NUMEROJS  SUCH  PROGRAMS  WERE  USED  IN  THE  COURSE  OF 

*  THP  STUDY 

4  44  444444444444444444444444444  444444444  44444444  444444 

*  INITIA.IZE  ARGUMENTS  TO  BE  USED  IN  MINIMIZATION  SUBROUTINE 

D  COMMON/ HAND J /FLAG) ERRFN, K00, Kl l , K22, K33 

44444444444444444444444444444444444444444444444444444 

TITLF  OPTIMIZATION  OF  FOURTH  ORDER  NONLINEAR  SYSTEM 
444 444444 444444 4 4 4444444444444 *44*4 4444 44444444 4*4 *44 
4  ESTABLISH  CONSTANTS  TO  BE  USED  IN  THE  PROGRAM 

CONST  0=1 00. | A= 1 . 0, IC=0 .0 

44444444444444444444444444444444444444444444444444444 
4  ASSIGN  INITIAL  VALUES  TO  THE  PARAMETERS 

4  TD  3 E  OPTIMIZED 

PAR AM  <0=5.41 ,<l=6.5B,K2=2.34,K3=.319 

44444444444444444444444444444444444444444444444 444444 

4  INITIALIZE  THE  PARAMETERS 

INITIAL 


Ip 
IF 
IF 
I  F 


( FLAG . LT • 0. 
( FLAG. LT. O. 
( FLAG.LT. 0. 
( FLAG  .L  T . 0 . 


)  K I  1  =K  1 
)  K22=K2 

)  K33  =  K  3 
)  K00=K0 

444  44444444  444  4444  4444444  444  4444  444  444444444444444444 

4  INPUT  A  STEP  FUNCTION 

DYNAMIC 

R= A4STEPI 0.0) 

4444  4444444444  44  44  4  444444  4444444444  444  444444  4  4  4  444  44  4 
4  SIMULATE  THE  SYSTEM 

DER I  VAT  I VE 

4 - COMPENSATED  SYSTEM - 

E=R-C 
£°  G=  KO  0  4  E 


Z=  E°  G-F 

U  =  LI  MI T  t  — 1 • 0 i  1 . 0 i 1 • 04  Z ) 

B=RPALPL (  I C  *  • 50 | U4S • O ) 

CODT  3=  3— H 

COOT 2= I NTGRL ( I C, COOT 3) 

COOT=INTGRL( IC,CD0T2) 

C= I NTGRL { I C  > CDUT ) 

H=6.S4CDUT2«-3.04CDOT 
F=K1  I4CDOT-K224CDOT2  +  K334CDOT3 
4444444444444444444444444444  44  44444  444444  444444  444  444 
4  CALCULATE  THE  PERFORMANCE  INDEX 

NOSORT 

IF(=.LT.O.O)  THEN 

EA  =  -  E 

E_SE 


EA=E 


ENDI  F 
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SORT 


E*  T=EA$T I  ME 

USm  =  U*'J 

PC05T=Q£JSQD*EAT 
COST  =  I NTGRL (  IC,PCOST) 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX  XXXXXXXXXXXX  XX  XXXX 

❖  DEFINE  THE  CRITERIA  TO  0E  USED  IN  THE  MINIMIZATION 

X  BOUTIN: 

TER  MI  N  A  L 

ERR  F  N  -  ZOZT 

V  v-  V  V  V  VV  V  -frv^^vvvvv  VVV^VYVJrVV^V^VI!'VV:VVVV,l'¥V7:t:VVvVvVVVV 

❖  DEFINE  THE  INTEGRATION  METHOD  TO  BE  USED 

METHOD  R<5 

X  XX  XXX  XX  XX  <:  #  <r  # £  X  #  <c  $  *  X  4c  ❖  £  X  <* &X  &X  $  $  $  *  * 

❖  DEFINE  THE  PERIOD  OF  INTEGRATION 

CONTROL  F I  NT  I M  =  I 0. 0 

X XX X XXX XX XXX XX XX  #  £  £  #  *  £  £  X $  £  $  #  XX  ££ 4:  4: X  <6  £ £  £  X  X  £  ❖  XX  XX 

❖  END  OF  MAIN  PROGRAM 
END 

STOP 

XXX  XXXX  XX  XX  XXX  XXXXX  XX-XXXX  XXX  XXXX  XXX  XX  XXXXXXXXXXXXXX 

❖  MINIMIZATION  SUBROUTINE 
FORTRAN 

IMPLICIT  R  E  A  L  £8  (A-H,0-Z) 

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX  X 

❖  SET  UP  THE  WORKING  ARRAYS 

DI  Mr  NS  ION  X(4),ST’P(4)  , Q( 4 )  ,  QQ(  4 )  ,  W(  4 ) 

A»  A»  %*#  A»  ^  <Ap  Ar  A  %Sf  A  A  %•#  A»  A»  A  A*  A  %Af  A  A»  A»  A»  A  A  A»  A*  A*  A#  A  A  A  A  A  %A*  A  %*#  A  A  A  A  A  A  A  %V  A 

+f  -v*  **  -v*  -v*  V  **%  -*x  v-  ***  v*  «**  v  -**  v  «v*  *%*  *+>  V  «v*  V*  -ir  W  -**  -v*  -*r  -v*  v  w  v  v  -r  ^  vv  -r  v  v  v  w  V  v 

❖  ESTABLISH  THE  INITIAL  STEP  SIZES  TO  BE  USED  IN  THE  SEARCH 

ST  E  3 (  1  )  =  1  . 

S  T  E  3  (  2  )  =  1  •  O 
S T E3 (  3  )  =  1 . 0 
STE3  |  '4  )  r  .  1  0 

❖  £ 

X  DEFINE  THE  NUMBER  OF  PARAMETERS 

N=4 

X  XX  XX X  X  £  X  X  £  £  XX  ££  £  ££❖  £££  ££  £££  £££££££  £££  £  X  £  ££  £  ££  £  £££  £  £ £ 

£  DEFINE  THE  NUMBER  OF  FUNCTION  CALLS  TO  BE  PERFORMED 

l T M A  X  =  2000. 0 

£££££££££  £££ ££ XXX X XXX  XX XXXX XXX XX XXX  XX  XX  XX  XXXXX  ££££  XXX 
X  DEFINE  THE  ERROR  IN  THE  CRITERION  FUNCTION  TO  BE  RFACHED 

*  BEFORE  THE  PROGRAM  TERMINATES 

C-TOL  =  1.00-6 

Am  «*.  Am  Am  Am  .V  Am  A.  Am  Am  Am  Am  Am  *V  Am  A,  JC  .V  A.  .*•  A.  V.  A.  AC  AC  AC  AC  A.  AC  At  Am  A.  Am  Am  Am  Am  Am  Am  Am  .C  AC  *C  Am  Am  A.  ,V  A.  A.  Am  A-  Am 

v  yvy  vvvw  v  v  vV- vvv  wvv’i'WVvvvvvv  vVv  vv  vvv  vvvvvv  vv  vvvv  vv  v 

*  SET  THE  STEPSIZE  REDUCTION  FACTORS  TO  BE  USED  IN  THE  SEARCH 

A _  PH  A  =  2.000 

BETA  =  0.5DO 

Am  A.  Am  Am  Am  A.  A.  .  V  ^  Af  ,V  Am  A.  A.  A.  A.  .<.  A,  A.  A.  A.  A.  A,  A.  A.  A  A>  A.  A,  A  AC  A.  .V  Ar  A,  A.  A.  A  A.  Ar  A  .•;  A-A'A.A.A.A.A.A.  A. 

V  V  W  >'  'f*  W  V  -t1  VV  'A  V  V  W  *t*  V  W  v  v  W  V  V  W  V  Y  V  Y  y  Y  V  -»•  V  ¥  V  V  ¥  V  'f  V  V  VA  V  V  ¥  ■<■ 

*  ADMINISTRATIVE  DATA  TO  TELL  THE  PROGRAM  THAT  THIS  IS  A 

£  MINIMISATION  ROUTINE 

PfUNT  =  0 

MI  NMAK  =  -  1 


CALL  THE  MINIMIZATION  SUBROUTINE 
CAL_  HOOKE  IX  ,STEP,N,  ITMAX , Cc TOL , ALPHA ,bETA , 
X  c-  , Q,QQ, W,  I  PR I  NT, M INMAX) 

STU3 

END 
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APPENDIX  B 

Computer  Code  for  the  Optimization  of  the 
Fourth- Order  System  Using  the  Cost  Function 

of  /0°°  [t  |e(i)|  +qu(t)2]  dt 


4  example  of  a  typical  minimization  routine 

*  FOR  THE  INTEGRAL  O-  TIME  MULTIPLIED  3Y  THE 

4  ABSO-UTE  value  of  the  error 

4: 44  44  4:4  444  4  4:4  4:  44: 4  4  4:  4:  44  4  4:444444  444444:44  4  44:4  44:4* 

*  NUMEROUS  SUCH  PROGRAMS  WERE  USED  IN  THE 

4  COURSE  O-  TH"  STUDY 

4  4:4  + 

4  IN  I T I A_ I ZE  ARGUMENTS  TO  BE  USED  IN  MINIMIZATION 
D  COMMON/HANDJ/FLAG, ERRFN, K l  1  , K22 , K33 

4  *  4  £  4: 4  4:  £  4:  4  4  if.  4  *  4  4: 4:  *  4  *  4  4  4  if  4:  *  4  4  4  4  4  if  if  4  *  4  4  4  4  4: 4:  *  4: 4:  4  * 

TITLE  OPTIMIZATION  OF  FOURTH  ORDER  LINEAR  SYSTEM 

*  $ 4=  4: *4=  £$£££4:*  4* 44  4  4* £ 4  4  4=  444444444 $*$$4:  4 4  4 4  4  44 4: 4  4: 

*  ESTABLISH  CONSTANTS  TO  BE  USED  IN  THE  PRuGRAM 
CONST  A=1 . 0 , I C=0. 0, K0=5 . 366 

4444444444444444444  4  4444444  44444444  4444  4444  4: 44 

4=  ASSIGN  INITIAL  VALUES  TO  THE  °ARAMETERS 

*  TO  3E  OPTIMIZED 

PARAM  •  < 1 =6. 591 0 , < 2= 2. 3320, K3= . 361 

4:  4  4:  4=  4=  4  4:  4  4:  4  4  4: 4:  4  4: 4=  4=  4=  4=  4=  *  4s  *  £  4=  4*  4  4  4=  4=  4=  4=  4=  4: 4:  4  4=  4=  4  4  4:  4:  44  4=  4= 

4:  INITIALIZE  THE  PARAMETERS 

INI TI AL 

I-  ( FLAG . _  T . 0 ♦  )  K 1  1 =K 1 
IF  (FLAG._T.O.)  K22- K2 

Ic  ( FLAG ._T. 0. )  K33=K3 

4444444444444444444444444444444444444444444444 
4:  INPUT  A  ST  E3  FUNCTION 

DYNAMIC 

R=A4STE=>(  0. 3  ) 

*4=4:4:  444444444444444444444444  444444444 4=4: 4=4=  4:4:4:  4:4: 

4  SIMJLATE  THE  SYSTEM 

DERIVATIVE 


4 - COMPENSATED  SYSTEM - 

E  =  K-C 
£°G=  K04  E 
U=E=G-F 

3=REALP_(TC, • 50 , U45 • 0 ) 

COOT  3  =  B-H 

COOT2=INTGRL(IC,COOT3) 

COOT=INTG°L( IC,C00T2) 

C= INTGRL ( I C, CDOT ) 

H  -  6  •  54CRUT2*  3. 04 CDOT 
F  =  K.  1  1  4 CDOT  ♦<22  4: CDOT 2  ♦<3  34: CDOT  3 
4444444444444444444444444444444444444444444444 
4  CALCULATE  THE  PERFORMANCE  INDEX 

NOSURT 

IF(=.^T.0.0)  then 

£  A  =  -  E 

else 

EA  =  = 

END  I  F 

S(j3T 

EAT  =  EA4T  I  '■*  E 

COST  =  I  NT  GRL l  IC ,EAT  ) 


SUBROUTINE 


V- 
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$3333333$  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 

*  DEFINE  THE  CRITERIA  TD  BE  USED  IN  THE  MINIMIZATION 

❖  ROUTINE 
TERMINAL 

FRRFM  =  COST 

$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$ 

<=  DEFINE  THE  INTEGRATION  METHOD  TO  BE  USED 

METHOD  R<5 

$$$$$$$$$  $$$$  ❖  $$$  £  $$$  $$$$$3$  3  33$  3$4=  $$£*£ 

❖  DEFINE  THE  PERIOD  OF  INTEGRATION 

CONTROL  FI  NT  I M= 10. 0 

<t  $ 3  3  3  3 3 3  £  3 3 $3 3$  £  $3  3  £  3«£«£ 3 3  $  3  3  3  3  3  33  33  3  $  3 $3  $  $  3$ 

*  END  OF  MAIN  PROGRAM 

END 

STOP 

❖  $-  $  3  33  £  3  3  3S3££  $  3  $  3  3  3333333333333$  $  $$$$$$$  $  $  $$  £ 

*  MINIMIZATION  ROUTINE 
FORTRAN 

IMPLICIT  REALMS  (A-H,0-Z) 


$$$$$$$$3  $$$$  $$$3 $$$$$3 $$$$$$$$$$$$$$$$$$ $$$$$ 

❖  SET-UP  THE  WORKING  ARRAYS 

DIMENSION  X ( 3 ) , STEP C 3 ) , Q ( 3 ) , QQ ( 3 ) j W ( 3) 

$  $$  $  $  $  $  $$  $  $$  $  $  $$<=$  $  $$❖  ❖  $$$$$$$$$$$$  $$$$$$  $  $3  3$ 

❖  ESTABLISH  THE  INITIAL  STEP  SIZES  TO  BE  USED  IN  THE  SEARCH 

STE3 ( 1  )  =  .  1 
STE3  t  2  )  =  •  10 
STEP( 3)=.01 

$$$$$$$$  $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$  $  $  $  $  $ 

$  DEFINE  THF  NUMBER  OF  PARAMETERS 


Nr  J 

❖  DEFINE  THE  NUMBER  OF  FUNCTION  CALLS  TO  BE  PERFORMED 

UMAX  =  600.0 

❖  DFFINE  THF  ERROR  IN  THE  CRITERION  FUNCTION  TO  BE  REACHED 

❖  BEFORE  THE  PROGRAM  TERMINATES 

C"T0L  =  1.0D-3 

£  $  $  $  £  $  $  £  $  £  $  $  $  $  £  $  $  £  $  $  $  $  $  $$  $  $  $  $  $  3  *  £  $ $ $  3  3  £  £  $  £  $  £  $ 4: 

❖  SET  THE  STEPSIZE  REDUCTION  FACTORS  TO  BF  USED  IN  THE 

❖  S  FAR  CH 


❖  v 


A.PHA  =  2.0D0 
BETA  =  0 • 5  D  0 

.1,  A  A  Ar  A  A.  W.  A.  .•.  A,<.  A  ^  A  A  A  A  AXX  A  A  A  X  A.  A  A.WX  .1.  A  A  AA. 

»'  V  V  V  V  VV  V  Y  rVVTVWV’'*TVWYVVVVVVvVVWVVWVW 

ADMINISTRATIVE  DATA  TO  TELL  THE  PROGRAM  THAT 


❖  MINIMIZATION  ROUTINE 

IPRINT  r  0 
MINMAX  =  -1 

333 333333 $$$$$$ $33 3$ 333 $3 3$ 333 33$$3 $33 3 $$$$$$$ 

*  CALL  THE  MINIMIZATION  SUBROUTINE 

CALL  H03KE( X  , STEP, N,  ITMAX ,  CFTOL  *  ALPHA, BETA, 
❖  C  p , Q , QQ , W ,  IPRINT j MINMAX) 

ST  O3 
END 


THIS 


IS  A 
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